Bounded Rationality in Concurrent Parity Games 

Krishnendu Chatterjee 
1ST Austria (Institute of Science and Technology Austria) 

Krishnendu . Chatter jee@ist . ac . at 



Abstract 

o 

P\J , We consider 2-player games played on a finite state space for an infinite number of rounds. The 

games are concurrent: in each round, the two players (player 1 and player 2) choose their moves inde- 
pendently and simultaneously; the current state and the two moves determine the successor state. We 
study concurrent games with cj-regular winning conditions specified as parity objectives. We consider 
the qualitative analysis problems: the computation of the almost-sure and limit-sure winning set of states, 
where player 1 can ensure to win with probability 1 and with probability arbitrarily close to 1, respec- 
tively. In general the almost-sure and limit-sure winning strategies require both infinite-memory as well 
r^ ' as infinite-precision (to describe probabilities). We study the bounded- rationality problem for qualitative 

^^ , analysis of concurrent parity games, where the strategy set for player 1 is restricted to bounded-resource 

^ ' strategies. In terms of precision, strategies can be deterministic, uniform, finite-precision or infinite- 

O . precision; and in terms of memory, strategies can be memoryless, finite-memory or infinite-memory. 

We present a precise and complete characterization of the qualitative winning sets for all combinations 
of classes of strategies. In particular, we show that uniform memoryless strategies are as powerful as 
^ ' finite-precision infinite-memory strategies, and infinite-precision memoryless strategies are as power- 

^«0 , ful as infinite-precision finite-memory strategies. We show that the winning sets can be computed in 

^J ' 0{n^'^'^^) time, where n is the size of the game structure and 2d is the number of priorities (or colors), 

and our algorithms are symbolic. The membership problem of whether a state belongs to a winning set 
can be decided in NP n coNP. While this complexity is the same as for the simpler class of turn-based 
parity games, where in each state only one of the two players has a choice of moves, our algorithms, 
that are obtained by characterization of the winning sets as /i-calculus formulas, are considerably more 
involved than those for turn-based games. 
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Concurrent games are played by two players on a finite state space for an infinite number of rounds. In each 
round, the two players independently choose moves, and the cunent state and the two chosen moves deter- 
mine the successor state. In deterministic concurrent games, the successor state is unique; in probabilistic 
concurrent games, the successor state is given by a probability distribution. The outcome of the game (or a 
play) is an infinite sequence of states. These games were introduced by Shapley IISha53i . and has been one 
of the most fundamental and well studied game models in stochastic graph games. We consider cu-regular 
objectives; that is, given an w-regular set <I> of infinite state sequences, player I wins if the outcome of the 
game lies in $. Otherwise, player 2 wins, i.e., the game is zero-sum. Such games occur in the synthesis and 
verification of reactive systems IIChu62[|RW87llPR89l (see also IIALW89[ lDil89l IAHK97I1 ). 

The player- 1 value vi{s) of the game at a state s is the limit probability with which player I can ensure 
that the outcome of the game lies in $; that is, the value fi(s) is the maximal probability with which 
player I can guarantee $ against all strategies of player 2. Symmetrically, the player-2 value V2{s) is the 
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limit probability with which player 2 can ensure that the outcome of the game lies outside <I>. The qualitative 
analysis of games asks for the computation of the set of almost-sure winning states where player 1 can ensure 
<I> with probability 1, and the set of limit-sure winning states where player 1 can ensure <I> with probability 
arbitrarily close to 1 (states with value 1); and the quantitative analysis asks for a precise computation of 
values. 

Traditionally, the special case of turn-based games has received most attention. In turn-based games, in 
each round, only one of the two players has a choice of moves. In turn-based deterministic games, all values 
are or 1 and can be computed using combinatorial algorithms IITho90[ ISch07[ IJPZ06II ; in turn-based 
probabilistic games, values can be computed by iterative approximation IICH06[ ICon92[ IGH08I . In this 
paper we focus on the more general concurrent situation, where in each round, both players choose their 
moves simultaneously and independently. Such concurrency is necessary for modeling the synchronous 
interaction of components [dAHMOO, dAHMOl]. The concurrent probabilistic games fall into a class of 
stochastic games studied in game theory IISha53ll . and the w-regular objectives, which arise from the safety 
and liveness specifications of reactive systems, fall into a low level (Ss n lis) of the Borel hierarchy. From a 
classical result of Martin liMar98 1 that established determinacy of Blackwell games it follows that concurrent 
probabilistic uj-v&gwlw games are determined, i.e., for each state s we have vi{s) + V2{s) = 1. Parity 
objectives can express all cj-regular conditions, and we consider concurrent games with parity objectives. 

Concurrent games differ from turn-based games in that optimal strategies require, in general, random- 
ization. A pure strategy must, in each round, choose a move based on the current state and the history 
(i.e., past state sequence) of the game. By contrast, a randomized strategy in each round chooses a proba- 
bility distribution over moves (rather than a single move). The move to be played is then selected at ran- 
dom, according to the chosen distribution. Randomized strategies are not helpful for achieving a value 
of 1 in turn-based probabilistic games pCJHOB! ICha07l . but they can be helpful in concurrent games, 
even if the game itself is deterministic IdAHKOTl. In contrast to turn-based deterministic and proba- 
bilistic games with parity objectives, where deterministic memoryless strategies exist for qualitative analy- 
sis BE J8 8 1 IZleQ 8 1 ID J W97 1 IC JH031 IChaOTl . in concurrent games, along with randomization, infinite-memory 
is required for limit-sure winning lldAHOOI . 

The strategies for qualitative analysis for concurrent games require two different types of infinite re- 
source: (a) infinite-memory, and (b) infinite-precision in describing the probabilities in the randomized 
strategies; (see example in MdAHOOII that limit-sure winning in concurrent Biichi games require both infinite- 
memory and infinite-precision). In many applications, such as synthesis of reactive systems, infinite- 
memory and infinite-precision strategies are not implementable in practice. Thus though the theoretical 
solution of infinite-memory and infinite-precision strategies was established in HdAHOOL the strategies ob- 
tained are not realizable in practice, and the theory to obtain implementable strategies in such games has 
not been studied before. In this work we consider the bounded rationality problem for qualitative analysis 
of concun^ent parity games, where player 1 (that represents the controller) can play strategies with bounded 
resource. To the best of our knowledge this is the first work that considers the bounded rationality problem 
for concurrent ci;-regular graph games. The motivation is clear as controllers obtained from infinite-memory 
and infinite-precision strategies are not implementable. 

In terms of precision, strategies can be classified as pure (deterministic), uniformly random, finite- 
precision, and infinite-precision (in increasing order of precision to describe probabilities of a randomized 
strategy). In terms of memory, strategies can be classified as memoryless, finite-memory and infinite- 
memory. In BdAHOOl the almost-sure and limit-sure winning characterization under infinite-memory, 
infinite-precision strategies were presented. In this work, we present (i) a complete and precise characteriza- 
tion of the qualitative winning sets for bounded resource strategies, (ii) symbolic algorithms to compute the 



winning sets, and (iii) complexity results to determine whether a given state belongs to a qualitative winning 
set. 

Our contributions for bounded rationality in concurrent parity games are summarized below. 

1. We show that pure memoryless strategies are as powerful as pure infinite-memory strategies. This 
result is obtained by a simple reduction to turn-based stochastic games. 

2. We show that uniform memoryless strategies are more powerful than pure infinite-memory strate- 
gies, and uniform memoryless strategies are as powerful as finite-precision infinite-memory strategies. 
Thus our results show that if player 1 has only finite-precision strategies, then no memory is required 
and uniform randomization is sufficient. Hence very simple (uniform memoryless) controllers can be 
obtained for the entire class of finite-precision infinite-memory controllers. The result is obtained by 
a reduction to turn-based stochastic games, and the main technical contribution is the characterization 
of the winning sets for uniform memoryless strategies by a |U-calculus formula. The /^-calculus for- 
mula not only gives a symbolic algorithm, but is also in the heart of other proofs of the paper. The 
//-calculus formula and the correctness proof are non-trivial generalizations of the classical result of 
Emerson- Jutla IIEJ911 for turn-based deterministic parity games. 

3. In case of finite-precision strategies, the almost-sure and limit-sure winning sets coincide. For almost- 
sure winning, uniform memoryless strategies are also as powerful as infinite-precision finite-memory 
strategies. However, we show with an example that infinite-memory infinite-precision strategies are 
more powerful than uniform memoryless strategies for almost-sure winning. For limit-sure winning, 
we show that infinite-precision memoryless strategies are more powerful than finite-precision infinite- 
memory strategies, and infinite-precision memoryless strategies are as powerful as infinite-precision 
finite-memory strategies. Our results show that if infinite-memory is not available, then no memory is 
required (memoryless strategies are as powerful as finite-memory strategies). The result is obtained 
by using the ^u-calculus formula for the uniform memoryless case: we show that a /i-calculus formula 
that combines the /^-calculus formula for almost-sure winning for uniform memoryless strategies and 
limit-sure winning for reachability with memoryless strategies exactly characterizes the limit-sure 
winning for parity objectives for memoryless strategies. 

4. As a consequence of the characterization of the winning sets as ^u-calculus formulas we obtain sym- 
bolic algorithms to compute the winning sets. We show that the winning sets can be computed in 
Q^^2d+3^ time, where n is the size of the game structure and 2d is the number of priorities (or col- 
ors), and our algorithms are symbolic. 

5. The membership problem of whether a state belongs to a winning set can be decided in NP n coNP. 
While this complexity is the same as for the simpler class of turn-based parity games, where in 
each state only one of the two players has a choice of moves, our algorithms, that are obtained by 
characterization of the winning sets as ^-calculus formulas, are considerably more involved than 
those for turn-based games. 

In short, our results show that if infinite-memory is not available, then memory is useless, and if infinite- 
precision is not available, then uniform memoryless strategies are sufficient. Let P, U, FP, IP denote 
pure, uniform, finite-precision, and infinite-precision strategies, respectively, and M, FM, IM denote 
memoryless, finite-memory, and infinite-memory strategies, respectively. For A G {P,U, FP, IP} and 
B G {M, FM, IM}, let Almosti {A, B, <1>) denote the almost-sure winning set under player 1 strategies that 



are restricted to be both A and B for a parity objective <5 (and similar notation for Limiti{A, B, <J>)). Then 
our results can be summarized by the following equalities and strict inclusion: 

Almosti {P, M, <^) = Almosti (P, /M, $) = Limiti {P, IM , $) 

C Almostilu, M, $) = Almosti{FP, IM, $) 

= Limiti{FP, IM , $) = Almosti{IP, FM , $) C Almosti{IP, IM , $). 

Limiti{FP, IM , $) C Limiti{IP, M, $) = Limiti{IP, FM , $) C Limiti{IP, IM , $). 

2 Definitions 

In this section we define game structures, strategies, objectives, winning modes and give other preliminary 
definitions. 

2.1 Game structures 

Probability distributions. For a finite set A, a probability distribution on A is a function 6 : A \-^ [0,1] 
such that J2a€A ^i^) ~ 1- ^^ denote the set of probability distributions on A by ^{A). Given a distribution 
6 € 'DiA), we denote by Supp((5) = {x G A\ S{x) > 0} the support of the distribution 5. 

Concurrent game structures. A (two-player) concurrent stochastic game structure Q = {S,A,ri,T2,5) 
consists of the following components. 

• A finite state space S. 

• A finite set A of moves (or actions). 

• Two move assignments Fi, F2 : S" i-> 2'* \ 0. For i € {1, 2}, assignment Fj associates with each state 
s G S the nonempty set Fj (s) C A of moves available to player i at state s. For technical convenience, 
we assume that Fj(s) n Tj{t) = unless i = j and s = t, for all i, j G {1, 2} and s,t G S. If this 
assumption is not met, then the moves can be trivially renamed to satisfy the assumption. 

• A probabilistic transition function 6: S xAxA 1-^ '^{S), which associates with every state s & S and 
moves ai € Fi(s) and 02 G '^2{s) a probability distribution 5{s,ai,a2) G ^(-S*) for the successor 
state. 

Plays. At every state s G S*, player 1 chooses a move ai G Fi(s), and simultaneously and independently 
player 2 chooses a move a2 G F2(s). The game then proceeds to the successor state t with probability 
5{s,ai,a2){t), for all t ^ S. For all states s G S* and moves ai G Fi(s) and 02 G r2(s), we indicate by 
Dest{s,ai,a2) = Supp(5(s,ai, 02)) the set of possible successors of s when moves ai, 02 are selected. A 
path or a. play of Q is an infinite sequence lo = (sq, si, S2, . . .) of states in S such that for all k > 0, there 
are moves a^f G Fi(sfc) and 03 G T2{sk) such that Sk+i G Dest{sk, a^, 03). We denote by Q the set of all 
paths. For a play lo = {sq, si, §2, ■ ■ ■) G 17, we define Inf{uj) = {s G S" | s^ = s for infinitely many k > 0} 
to be the set of states that occur infinitely often in lo. 

Size of a game. The size of a concurrent game is the sum of the size of the state space and the number of the 
entries of the transition function. Formally the size of a game is jS"] + J2seS aeri(s) ber2(s) \Dest{s, a,b)\. 



Turn-based stochastic games and MDPs. A game structure Q is turn-based stochastic if at every state at 
most one player can choose among multiple moves; that is, for every state s € S there exists at most one 
i G {1, 2} with |rj(s)| > 1. A game structure is a player-2 Markov decision process if for all s € S" we 
have |ri(s)| = 1, i.e., only player-2 has choice of actions in the game. 

Equivalent game structures. Given two game structures Qi = {S,A,Ti,r2,Si) and Q2 = 

{S,A,Ti,T2,S2) on the same state and action space, with different transition function, we say that Qi 
is equivalent to Q2 (denoted Qi = Q2) if for all s € 5" and all ai € ri(s) and a2 G ^2{s) we have 
Supp((5i(s, ai, 02)) = Supp((52(s, 01,02)). 

2.2 Strategies 

A strategy for a player is a recipe that describes how to extend a play. Formally, a strategy for player 
i G {1,2} is a mapping ttj : S^ 1-^ ^(^) that associates with every nonempty finite sequence x G S*"*" 
of states, representing the past history of the game, a probability distribution 7rj(x) used to select the next 
move. The strategy tt-i can prescribe only moves that are available to player i; that is, for all sequences 
X ^ S* and states s G 5, we require that Supp(7rj(x • s)) C Ti{s). We denote by IIj the set of all strategies 
for player i G {1, 2}. 

Given a state s ^ S and two strategies vri G IIi and 1^2 G 112, we define Outcomes {s,7ri, 1:2) C fi to 
be the set of paths that can be followed by the game, when the game starts from s and the players use the 
strategies tti and 7r2. Formally, {sq, si, S2, . . .) G Outcomes{s, 1^1,112) if so = ■? and if for all A: > there 
exist moves a\ G ri(sfe) and a\ G T2{sk) such that 

7ri(so,...,Sfc)(ai) > 0, 7r2(so, • • • , Sfc)(a2) > 0, Sk+i ^ Dest{sk:a'l,a2). 

Once the starting state s and the strategies vri and 1:2 for the two players have been chosen, the probabilities 
of events are uniquely defined IIVar85l . where an event ^ C fi is a measurable set of path^j. For an event 
^ C fi, we denote by Pr^i''^^ (^) t^g probability that a path belongs to A when the game starts from s and 
the players use the strategies vri and 1:2- 

Classification of strategies. We classify strategies according to their use of randomization and memory. 
We first present the classification according to randomization. 

1. (Pure). A strategy vr impure (deterministic) if for all x G S^ there exists o G A such that 7r(x)(a) = 1. 
Thus, deterministic strategies are equivalent to functions S^ i-)- A. 

2. (Uniform). A strategy -k is uniform if for all x G S^ we have tt{x) is uniform over its support, i.e., 
for all a G Supp(^(2;)) we have TT{x){a) = |Supp^(^(^))| - 

3. (Finite-precision). A strategy vr is finite-precision if there exists a bound 6 G N such that for all 
X G 5+ and all actions a we have vr(x)(a) = ^, where i, j G N and < i < j < b and j > 0, i.e., 
the probability of an action played by the strategy is a multiple of some ^ G N such that i < b. 

We denote by Iff, 11^, Iff ^ and 11^^ the set of pure (deterministic), uniform, finite-precision, and infinite- 
precision (or general) strategies for player i, respectively. Observe that we have the following strict inclu- 
sion: nf c nf C U[P c nf . 



' To be precise, we should define events as measurable sets of paths sharing the same initial state, and we should replace our 
events with families of events, indexed by their initial state IKSK66I . However, our (slightly) improper definition leads to more 
concise notation. 



1. (Finite-memory). Sttategies in general are history-dependent and can be represented as follows: let 
A^ be a set called memory to remember the history of plays (the set A4 can be infinite in general). 
A strategy with memory can be described as a pair of functions: (a) a memory update function vr^ : 
S y< M. ^ M., that given the memory J\A with the information about the history and the current state 
updates the memory; and (b) a next move function 7r„ : S" x TW i-^ ^(^) that given the memory and 
the current state specifies the next move of the player. A strategy is finite-memory if the memory M. 
is finite. 

2. (Memoryless). A memoryless strategy is independent of the history of play and only depends on the 
current state. Formally, for a memoryless strategy vr we have tt{x ■ s) = 7r(s) for all s G 5 and all 
X € S* . Thus memoryless strategies are equivalent to functions S ^^ ^(A). 

We denote by lif^ , 11™ and n™ the set of memoryless, finite-memory, and infinite-memory (or general) 
strategies for player i, respectively. Observe that we have the following strict inclusion: 11^^ C 11™ C 

2.3 Objectives 

We specify objectives for the players by providing the set of winning plays $ C J] for each player. In this 
paper we study only zero-sum games | RF9l]|FV97ll . where the objectives of the two players are comple- 
mentary. A general class of objectives are the Borel objectives l|Kec95i A Borel objective $ C S""^ is a 
Borel set in the Cantor topology on S^ . In this paper we consider uj-regular objectives ffTho90l . which lie 
in the first 21/2 levels of the Borel hierarchy (i.e., in the intersection of S3 and U^). We will consider the 
following (xi-regular objectives. 

• Reachability and safety objectives. Given a set T C S of "target" states, the reachability objec- 
tive requires that some state of T be visited. The set of winning plays is thus Reach(r) = {u = 
{sq, Si, S2, • • •) € il I 3/;; > 0. Sk € T}. Given a set F C S, the safety objective requires that only 
states of F be visited. Thus, the set of winning plays is Safe(F) = {uj = (sq, si, S2, • • •) G J^ | VA; > 
0. Sk G F}. 

• Biichi and co-BUchi objectives. Given a set S C 5 of "Biichi" states, the Biichi objective requires 
that B is visited infinitely often. Formally, the set of winning plays is Buchi(i?) = {w S il [ 
Inf{uj) n B ^ (/}}. Given CCS', the co-Biichi objective requires that all states visited infinitely often 
are in C. Formally, the set of winning plays is co-Buchi(C) = {u £ Q \ Inf{uj) C C}. 

• Parity objectives. For c, d G N, we let [c..d\ = {c, c + 1, . . . , d}. Let p : S ^-^ [0..d] be a function 
that assigns apriority p{s) to every state s £ S, where d G N. The Even parity objective requires that 
the maximum priority visited infinitely often is even. Formally, the set of winning plays is defined 
as Parity(p) = {uj £ Q, \ max {p{Inf{uj))^ is even }. The dual Odd parity objective is defined as 
coParity(j)) = {w G ^2 | max {p{Inf{uj))) is odd }. Note that for a priority function p : S* 1— )■ {1, 2}, 
an even parity objective Parity(p) is equivalent to the Biichi objective Biichi (p~^(2)), i.e., the Biichi 
set consists of the states with priority 2. Hence Biichi and co-Biichi objectives are simpler and special 
cases of parity objectives. 

Given a set f/ C 5 we use usual LTL notations □[/, OC/, DOC/ and <>□[/ to denote 
Safe(C/),Reach(C/),Biichi(C/) and co-Biichi(C/), respectively. Parity objectives are of special importance 
as they can express all a;-regular objectives, and hence all commonly used specifications in verifica- 
tion IITho90ll . 



2.4 Winning modes 

Given an objective <I>, for all initial states s € S, the set of paths <l> is measurable for all choices of the 
strategies of the player IIVar85l . Given an initial state s G 5, an objective $, and a class U^ of strategies we 
consider the following winning modes for player 1 : 

Almost. We say that player 1 wins almost surely with the class 11^ if the player has a strategy in Hl to win 
with probability 1, or Btti e n^ . \/tt2 € U2 . Prji''^^^^) = i 

Limit. We say that player 1 wins limit surely with the class U'l if the player can ensure to win with probabil- 
ity arbitrarily close to 1 with IIj^, in other words, for all e > there is a strategy for player 1 in nf that 
ensures to win with probability at least 1 — e. Formally we have sup^^gjjc inf7r2Gn2 Pr^^'^'^i^) = 1. 

We abbreviate the winning modes by Almost and Limit, respectively. We call these winning modes the qual- 
itative winning modes. Given a game structure G, for Ci G {P, U, FP, IP} and C2 G {M, FM , IM} we 
denote by Almostf{Ci, C2, ^) (resp. Limitf{Ci, C2, $)) the set of almost-sure (resp. limit-sure) winning 
states for player 1 in G when the strategy set for player 1 is restricted to 11]^ ^ n 11^ ^. If the game structure 
G is clear from the context we omit the superscript G. 

2.5 Mu-calculus, complementation, and levels 

Consider a mu-calculus expression ^ = fxX . ip{X) over a finite set S, where ^ : 2*^ H- 2'^ is monotonic. 
The least fixpoint ^ = fiX . ip{X) is equal to the limit limfc^oo Xk, where Xq = 0, and X^+i = ■ip{Xk). 
For every state s G ^, we define the level A; > of s to be the integer such that s X^ and s € ^fc+i. The 
greatest fixpoint ^ = uX . ipiX) is equal to the limit limfc^oo-^fc. where Xq = S, and X^+i = ip{Xk). 
For every state s ^ ^, we define the level /c > of s to be the integer such that s E Xf^ and s ^fc+i- 
The height of a mu-calculus expression AX . ip{X), where A G {^, i^}, is the least integer h such that 
Xfi = limfc__^oo Xj.. An expression of height h can be computed in h + I iterations. Given a mu-calculus 
expression ^ = AX .ip{X), where A € {fi, v}, the complement -1^ = S \ ^ of A is given by AX . -■^'(-'X), 
where A = ;U if A = i^, and A = i^ if A = ;U. For details of ^u-calculus see IIKoz831lEJ91ll . 

Distributions and one-step transitions. Given a state s G 5, we denote by Xi = ^(ri(s)) and X2 — 

'D{T2{s)) the sets of probability distributions over the moves at s available to player 1 and 2, respectively. 
Moreover, for s e 5, X C S, ^1 € xf' and ,^2 £ xl ^^ denote by 

p|-«^(x)= Y. E Y.^M-Uh)-Ks.aMit) 

aeri(s) b&2{s) t£X 
the one-step probability of a transition into X when players 1 and 2 play at s with distributions ,^1 and ^2, 
respectively. Given a state s and distributions ^1 € Xi and ^2 G X2 ^^ denote by Dest{s, £,1,^,2) = {t ^ S \ 
P2 (t) > 0} the set of states that have positive probability of transition from s when the players play ,^1 
and ^2 at s. For actions a and b we have Dest{s, a,b) = {t ^ S \ 6{s, a, b){t) > 0} as the set of possible 
successors given a and b. For A C ri(s) and B C r2(s) we have Dest{s, A, B) = IJ^^yi ^g^ Dest{s, a, b). 

Theorem 1 The following assertions hold: 

1. IICJH03II For all turn-based stochastic game structures G with a parity objective $ we have 

Almosti {P, M, $) = Almosti {IP, IM,^) = Limiti {P, M, $) = Limiti {IP, IM , $) 

2. lidAHOOl Let Gi and G2 be two equivalent game structures with a parity objective ^, then we have 
l.Almostf'{IP,IM,^) =Almostf'{IP,IM,^); 2. Limit^'{IP, IM,<^) = Limit^' {IP , IM , ^) 



3 Pure, Uniform and Finite-precision Strategies 

In this section we present our results for pure, uniform and finite-precision strategies. We start with the 
characterization for pure strategies. 

3.1 Pure strategies 

The following result shows that for pure strategies, memoryless strategies are as strong as infinite-memory 
strategies, and the almost-sure and limit-sure sets coincide. 

Proposition 1 Given a concurrent game structure G and a parity objective $ we have 

Almostf{P, M, $) = Almostf{P, FM , $) = Almostf{P, IM , $) = 
Limitflp, M, $) = Limitf{P, FM, $) = Limitf{P, IM, $). 

Proof. The resuh is obtained as follows: we show that Almostf {P, M , ^) = Almostf {P, IM , ^) = 
Limitf {P, IM , ^) and all the other equalities follow (by inclusion of strategies). The main argument is 
as follows: given G we obtain a turn-based stochastic game G where player 1 first choses an action, then 
player 2 chooses an action, and then the game proceeds as in G. Then it is straightforward to establish that 
the almost-sure (resp. limit-sure) winning set for pure and infinite-memory strategies in G coincides with 
the almost-sure (resp. limit-sure) winning set for pure and infinite-memory strategies in G. Since G is a 
turn-based stochastic game, by Theorem [T] (part 1), it follows that the almost-sure and limit-sure winning 
set in G coincide and they are same for memoryless and infinite-memory strategies. 

We now present the formal reduction. Let G = {S,A,Ti,r2,S) and let the parity objective <1> be 
described by a priority function p. We construct G = {S,A, Ti, r2, 6) with priority function p as follows: 

1. S = SU {(s, a) I s G 5, a G Ti{s)}; 

2. A = A U {_L} where _L A; 

3. for s G 5 n S" we have f i(s) = Ti{s) and f2(s) = {-L}; and for (s, a) G 5 we have f 2((s, a)) = 
r2(s)andri((s,a)) = {_L}; and 

4. for s G 5 n 5" and a G ri(s) we have 6{s, a, -L)(s, a) = 1; and for {s, a) ^ S and b G r2(s) we have 
5{{s, a), _L, b) = 6{s, a, b); 

5. the function p in G is as follows: for s G 5 n 5 we have p{s) = p{s) and for (s, a) G 5 we have 

p{{s,a)) =p{s). 

It is straightforward to establish by mapping of pure strategies of player 1 in G and G that 

{a)Almostf{P,M,<^) = Almost'{{P,M,^) D S, 

{b)Almostf{P,IM,^) = Almostf{P,IM,^)nS, 

{c)Limitf{P,M,'^) = Limitf{P,M,$)nS, 

{d)Limitf{P,IM,^) = Limitf{P,IM,$)nS; 

where $ = Parity (p). It follows from Theorem [T] (part 1) that 

Almostf{P, M, $) = Almostf{P, IM , $) = Limitf{P, M, $) = Limitf{P, IM , $). 



Hence the desired result follows. I 

Algorithm and complexity. The above proposition gives a linear reduction to turn-based stochastic games. 
Thus the set A/mo^f i (P, M, $) can be computed using the algorithms for turn-based stochastic parity games 
(such as IICJH03I ). We have the following results. 

Theorem 2 Given a concurrent game structure G, a parity objective ^, and a state s, whether s G 
Almost i{P, IM,^) = Limit i{P, IM,^) can be decided in NP n coNP. 

3.2 Uniform and Finite-precision 

In this subsection we will present the characterization for uniform and finite-precision strategies. 

Example 1 It is easy to show that Almosti{P, M, $) C Almosti{U, M, $) by considering the matching 
penny game. The game has two states sq and si. The state si is an absorbing state (a state with only self- 
loop as outgoing edge; see state si of Fig [S]) and the goal is to reach si (equivalently infinitely often visit 
si). At So the actions available for both players are {a, b}. If the actions match the next state is si, otherwise 
Sq. By playing a and b uniformly at random at sq, the state si is reached with probability 1, whereas for any 
pure strategy the counter-strategy that plays exactly the opposite action in every round ensures si is never 
reached. I 

We now show that uniform memoryless strategies are as powerful as finite-precision infinite-memory 
strategies and the almost-sure and limit-sure sets coincide for finite-precision strategies. We start with two 
notations. 

Uniformization of a strategy. Given a strategy vri for player 1, we define a strategy vr" that is obtained 
from TTi by uniformization as follows: for all w € 5^ and all a G Supp(7ri(tt;)) we have 7r"(i«)(a) = 
-p 7 — r^--. We will use the following notation for uniformization: irV = unif (vri ). 

|Supp{7ri(«;))| ^ 1 V 1/ 

6-finite-precision strategies. Given 6 € N, a strategy is 5-finite-precision if for all x G S~^ and all actions a 
we have 7r(x)(a) = ^, where z, j € N and < i < j < b and j > 0. 

Proposition 2 Given a concurrent game structure G and a parity objective $ we have 

AlmostfiU, M, $) = AlmostfiU, FM , $) = Almostf{U, IM , $) = 
Limitflu, M, $) = Limitf{U, FM , $) = Limitf{U, IM , $) = 
Almostf{FP, M, $) = Almostf{FP, FM , $) = Almostf{FP, IM , $) = 
Limitf{FP, M, $) = Limitf{FP, FM, $) = Limitf{FP, IM, $) 

Proof. The resuh is obtained as follows: we show that A/mosff(C/,M, <!)) = Almostf{FP, IM ,^) = 
Limitf {FP , IM, <I>) and all the other equalities follow (by inclusion of strategies). The key argument is as 
follows: fix a bound b, and we consider the set of 6-finite-precision strategies in G. Given G we obtain 
a turn-based stochastic game G where player 1 first chooses a 6-finite-precision distribution, then player 2 
chooses an action, and then the game proceeds as in G. Then we establish that the almost-sure (resp. 
limit-sure) winning set for 6-finite-precision and infinite-memory strategies in G coincides with the almost- 
sure (resp. limit-sure) winning set for 6-finite-precision and infinite-memory strategies in G. Since G is 
a turn-based stochastic game, by Theorem [T] it follows that the almost-sure and limit-sure winning set in 
G coincide and they are same for memoryless and infinite-memory strategies. Thus we obtain a 6-finite- 
precision memoryless almost-sure winning strategy vri in G and then we show the uniform memoryless 



tt" = unif(7ri) obtained from uniformization of vr" is a uniform memoryless almost-sure winning strategy 
in G. Thus it follows that for any finite-precision infinite-memory almost-sure winning strategy, there is a 
uniform memoryless almost-sure winning strategy. 

We now present the formal reduction. Let G = {S,A,Ti,T2:5) and let the parity objective ^ be 
described by a priority function p. For a given bound b, let f{s,b) = {/ : Ti{s) i-^ [0,1] [ Va G 
Ti{s) we have /(a) = j,i,j e N,0 < i < j < b,j > and YyaeViis) fi"-) = 1} denote the set of 
6-finite-precision distributions at s. We construct G = {S,A, Ti, r2, 6) with priority function p as follows: 

1. S = Su{is,f)\seS,fef{s,b)y, 

2. A=AU{f\ s e 5, / e 7(s, 6)} U{±} where ±0 A; 

3. fors G 5n5wehaveri(s) = /(s, 6) and Fa (s) = {!}; and for (s, /) G S we have r2((s, /)) = 
r2(s)andri((s,/)) = {±};and 

4. for s G Sjl S and / G /(s, 6) we have ^{s, f, _L)(s, /) = 1; and for (s, /) G S*, 6 G r2(s) and t G 5 
we have ?((s, /), ±, 6)(t) = EaGri{.) /(«) ' '5(«' a, b){t); 

5. the function p in G is as follows: for s G 5 n 5 we have p{s) = p{s) and for (s, /) G S we have 

P{(.sj)) =p{s). 

Observe that given 6 G N the set f{s, b) is finite and thus G is a finite-state turn-based stochastic game. It is 
straightforward to establish mapping of 6-finite-precision strategies of player 1 in G and with pure strategies 
in G, i.e., we have 

(a)A/mo5ff(6FP,M,$) = A/mo5ff (P,M, $) n 5, 
{b)Almostf{bFP,IM,^) = Almostf{P,IM,^)nS, 
{c)Limitf{bFP,M,<^) = Limitf{P,M,^)nS, 
(d) LimitfibFP, IM, $) = Limitf{P, IM, $) n S, 

where <1> = Parity(pi) and bFP denote the set of 6-finite-precision strategies in G. By Theorem[T]we have 

Almostf{P, M, $) = Almostf{P, IM , $) = Limitf{P, M, $) = Limitf{P, IM , $). 

Consider a pure memoryless strategy vfi in G that is almost-sure winning from Q = Almostf {P, M, <l), and 
let TTi be the corresponding fe-finite-precision memoryless strategy in G. Consider the uniform memoryless 
strategy vr" = unif (vri) in G. The strategy vri is an almost-sure winning strategy from Q n S. The player-2 
MDP G,rj and G,r« are equivalent, i.e., G-^-^ = G^rj* and hence it follows from Theorem [U that Trf is an 
almost-sure winning strategy for all states in Q n S". Hence the desired result follows. I 

Computation of Almost i{U,M,^). It follows from Proposition |2] that the computation of 
Almost i{U, M, ^) can be achieved by a reduction to turn-based stochastic game. We now present the main 
technical result of this subsection which presents a symbolic algorithm to compute Almost i{U, M, <I>). The 
symbolic algorithm developed in this section is crucial for analysis of infinite-precision finite-memory strate- 
gies, where the reduction to turn-based stochastic game cannot be applied. The symbolic algorithm is ob- 
tained via /Lt-calculus formula characterization. We first discuss the comparison of our proof with the results 
of HCdAHIII and then discuss why the recursive characterization of turn-based games fails in concurrent 
games. 
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Comparison with HCdAHlll . Our proof structure based on induction on the structure of /i-calculus formu- 
las is similar to the proofs in HCdAHlll . In some aspects the proofs are tedious adaptation but in most cases 
there are many subtle issues and we point them below. First, in our proof the predecessor operators are dif- 
ferent from the predecessor operators of BCdAHllll . Second, in our proof from the ^-calculus formulas we 
construct uniform memoryless strategies as compared to infinite memory strategies in BCdAHlll . Finally, 
since our predecessor operators are different the proof for complementation of the predecessor operators 
(which is a crucial component of the proof) is completely different. 

Failue of recursive characterization. In case of turn-based games there are recursive characterization of 
the winning set with attractors (or alternating reachability). However such characterization fails in case of 
concurrent games. The intuitive reason is as follows: once an attractor is taken it may rule out certain action 
pairs (for example, action pair ai and bi must be ruled out, whereas action pair ai and 62 may be allowed in 
the remaining game graph), and hence the complement of an attractor maynot satisfy the required sub-game 
property. For details, see examples in MdAHOOi IdAHKOTl why the recursive characterization fails. 

Strategy constructions. Since the recursive characterization of turn-based games fails for concurrent 
games, our results show that the generalization of the /x-calculus formulas for turn-based games can char- 
acterize the desired winning sets. Moreover, our correctness proofs that establish the correctness of the 
//-calculus formulas present explicit witness strategies from the /i-calculus formulas. Morover, in all cases 
the witness counter strategies for player 2 is memoryless, and thus our results answer questions related to 
bounded rationality for both players. 

We now introduce the predecessor operators for the /z-calculus formula required for our symbolic algo- 
rithms. 

Basic predecessor operators. We recall the predecessor operators Prei (pre) and Aprcj^ (ahnost-pre), 
defined for all s G 5 and X,Y QShy: 



Prei(X) 
Aprei(y,X) 



{sG5|3eiGxf.V6Gx!.^l^'^'W 
{sGS\3^iexl-ya&xt-Pt'^'(Y): 



1}; 

1AP|^'«^(X) >0} 



Intuitively, the Prei(X) is the set of states such that player 1 can ensure that the next state is in X with 
probability 1, and Aprei{Y, X) is the set of states such that player 1 can ensure that the next state is in Y 
with probability 1 and in X with positive probability. 

Principle of general predecessor operators. While the operators Apre and Pre suffice for solving Biichi 
games, for solving general parity games, we require predecessor operators that are best understood as the 
combination of the basic predecessor operators. We use the operators |*J and fJ] to combine predecessor 
operators; the operators |*J and (*] are different from the usual union U and intersection n. Roughly, let a 
and /3 be two set of states for two predecessor operators, then the set a fJ] /3 requires that the distributions 
of player 1 satisfy the conjunction of the conditions stipulated by a and /3; similarly, |*J corresponds to 
disjunction. We first introduce the operator Apre |*J Pre. For all s G 5 and Xi,Yq,Yi C S, we define 



Aprei(yi,Xi)yPrei(yo: 



s G 5 I 3^1 G xly^2 G X2- 



(P^'«^(Xi)>OAP^'«^(yi) = l) 

V 



Note that the above formula corresponds to a disjunction of the predicates for Apre^^ and Prci. However, it 
is important to note that the distributions ^1 for player 1 to satisfy (^2 for player 2 to falsify) the predicate 
must be the same. In other words, Apre^ (Yi , Xi ) |*J Prci {Yq ) is not equivalent to Apre^ ( Yi , Xi ) U Prci {Yq ) . 
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General predecessor operators. We first introduce two predecessor operators as follows: 

APreOddi(i, y„, X„, . . . , Y^-u ^„-i) 
= Aprei(y„,X„)yAprei(y„_i,X„_i)y • • • yAprei(y„_i,X„_i); 

APreEveni(i, y„, X„, . . . , y„„i, X„_i, y„_i_i) 
= Aprei(y„,X„)yAprei(y„_i,X„_i)y • • • yAprei(y„_i,X„_i)yPrei(y„_i_i] 

The formal expanded definitions of the above operators are as follows: 

APreOddi(i, y„, X„, . . . , Yn-i, X^-i) = 

(p|^'«^(x„)>OAP|i'«^(y„) = i) 



5 G 5 I 36 G x!-V6 G xi- 



3?1:C2/ 



V 



3^1 .6 / 



(Pi^'^^(x„_i) > APf '^^(y^-i) = 1) 
V 



V 

{p|''^^Xn-^) > A p^'«^(y„-.) = 1) 

APreEveni(i, y„, X„, . . . , y„_j, X„_i, y„_i_i) = 

(p|^'«^(x„)>OAP|^'«^(y„) = i) 



(p|^'«^(x„„i)>OAP^'«^(y, 



n-lJ 



5 G 5 I 36 G x!-V6 G xi- 



V 

)A 

V 

V 

(p^'«^(x„_,)>OAP^'«^(y„_,) 

V 

(p^'«^(y„_,_i) = i) 

Observe that the above definition can be inductively written as follows: 

1. We have APreOddi(0, y„, X„) = Apre^(y„, Xn) and for i > 1 we have 

APreOddi(i, y„, X„, . . . , y„_i, X„_i) 
= Aprci (y„, Xn) y APreOddi (i - 1, y„_i , X„_i , . . . , y. 



, -'^n 



n— i) ^"-n— « 



2. We have APreEveni(0, y„, Xn, Yn^i) = Apre]^(y„, X„) |*JPrei(y„_i) and for i > 1 we have 

APreEveni(i, y„, X„, . . . , y„_j, X„_i, yn-j-i) 
= Aprei(y„, X„) y APreEveni(i - 1, y„_i, X„„i, . . . , Yn-i, Xn-i, y„--i-i) 
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Dual operators. The predecessor operators Pospre2 (positive-pre) and Apre2 (almost-pre), defined for all 
s G 5 and X, y C 5 by: 

Pospre2(X) = {c, e 5 I Vei G xf • 3^2 G x! • pI''^^{X) > 0}; 
Apre2(y, X) = {s G 5 I V6 G X? • 36 G xf • pI"^'{Y) = 1 A P|^'«^(X) > 0} . 

Observe that player 2 is only required to play counter-distributions ^ against player 1 distributions S,i. We 
now introduce two positive predecessor operators as follows: 

PosPreOdd2(i, Yn,Xn,..., Yn-i,Xn-i) 
= P0Spre2(yn)HApre2(X„, Yn-l)\S ■ ■ ■ \S^P^^2(.Xn-i+l,Yn-i)\*jPre2{Xn-i) 

PosPreEven2(i, Y^, X„, . . . , Yn-i, Xn-i, Yn-i-i) 
= Pospre2(i;0 W Apre2(X„, Y^-i) 

y • • • yApre2(X„_i+i,y„_i)yApre2(X„_i,y„__i_i) 
The formal expanded definitions of the above operators are as follows: 
PosPreOdd2(i, y„, X„, . . . , Yn-i, ^n-i) = 

V 

V 

(p|^'«^(y„_2) > A pl'^^^Xn-i) = 1) 

5 G 5 I vei G xf-36 G xi- V 



V 

(p|^'«^(y„_,) > A p|^'«^(x„_,+i) = 1) 

V 

PosPreEven2(i, !"„, X„, . . . , y„_i, Xn-i, Yn-i-i) = 

(P|^'«^(y„)>0) 

V 



5 G 5 I Va G xf-36 G x!- 



(P|i'«2(y„_i) > A P|^'«^(X„) = 1) 

V 

(p|^'«^(y„_2) > A p^'«^(x„_i) = 1) 
V 



V 

(P|^'«^(y„_,_l) > A P|''^^Xn-^) = 1) 

The above definitions can be alternatively written as follows 
PosPreOdd2(i, Yn,Xn, • • • , Yn-i, X^-i) = 

Pospre2(yn) H APreEven2(i - l,X„,y„_i,...,X„_j+i,y„_i,X„ 
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PosPreEven2(i, Yn, X„, . . . , Yn-i,Xn-i,Yn-i-i) = 

Pospre2(yn) H APreOdd2(J, X„, Yn-i, . . . , Xn-i, Y^-i-i). 

Remark 1 Observe that if the predicate Pospre2{Yn) is removed from the predecessor operator 
PosPreOdd2{i, Yn,Xn, ■■■ , Yn^i, Xn-i) (resp. PosPreEven2{i, Yn, X„, . . . , y„_i, X„_j, y„_j_i)j, 

then we obtain the operator APreEven2{i — l,X„,y„_i, . . . ,X„_j+i,y„„j,X„_j) (resp. 
APreOdd2ii, X„, y„_i, . . . , Xn-i, Yn-i-i)). 

We first show how to characterize the set of almost-sure winning states for uniform memoryless strate- 
gies and its complement for parity games using the above predecessor operators. We will prove the following 
result by induction. 

1. Case 1. For a parity function p : S ^-^ [0..2n — 1] the following assertions hold. 

(a) For all T C S" we have W C Almost i{U, M, Parity (p) U OT), where W is defined as follows: 

T 

U 
B2n-inAPreOddi(0,y„,X„) 

u 

B2n-2 n APreEveni(0, y„, X„, Yn-i) 

u 

B2n-3 n APreOddi(l, y„, x„, y„_i, X„_i) 

u 

B2n-4 n APreEveni(l, y„, X„, y„_i, X„_i, y„_2) 



l^Yn-UXn-l^Yn-l-flXn-l- ■ ■ ■ vYi.^iXi.uYq. 



Bi n APreOddi(n - 1, y„, X„, . . . , Yi,Xi) 

u 

So n APreEveni(n - 1, y„, X„, . . . ,Yi,Xi,Yq) 

We refer to the above expression as the almost-expression for case 1 . If in the above formula we 
replace APreOddi by APreOdd2 and APreEveni by APreEven2 then we obtain the dual almost- 
expression for case 1. From the same argument as correctness of the almost-expression and the 
fact that counter-strategies for player 2 are against memoryless strategies for player 1 we obtain 
that if the dual almost-expression is Wd for T = 0, then Wd C {s € 5 | Vtti € 11^37^2 G 
n2. PrJi'''2(coParity(p)) = 1}. 

(b) We have Z C ^Almosti [U, M, Parity (p)), where Z is defined as follows 

B2n-i n PosPreOdd2(0, y„, X„) 

u 

B2n-2 n PosPreEven2(0, y„, X„, y„_i) 

u 

B2n-3 n PosPreOdd2(l, Yn,Xn, Yn-1, X„_i) 

u 

B2n-4 n PosPreEven2(l, y„, X„, y„_i, X„_i, y„_2) 
Bi n PosPreOdd2(n - 1, y„, X„, . . . , Yi,Xi) 

u 

Bo n PosPreEven2(n - 1, y„, X„, . . . , Yi,Xi,Yo) 



IJ-Yn-iyXn-jJ-Yn-l-iyXn-l- ■ ■ ■ fiYiMXi.IJ.YQ. 
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We refer to the above expression as the positive-expression for case 1 . 

2. Case 2. For a parity function p : S ^-^ [1..2n] the following assertions hold. 

(a) For all T C 5" we have W C Almosti{U, M, Parity (p) U OT), where W is defined as follows: 

T 

U 
^2nnPrei(y„_i) 

u 

B2n-i n APreOddi(0, y„_i, X„_i) 

u 

B2n-2 n APreEveni (0, y„_i , X„_2 , Yn-2) 

u 

S2„_3nAPreOddi(l,y„_i,X„_i,y„_2,^n-2) 



uYn-l.lJ,Xn-l. ■ ■ ■ vYi.^Xi.vYq.IJlXq 



B2 n APreEveni (n - 2, y„_i , X„_i , . . . , Fi , Xi , Yo) 

u 

5i n APreOddi(n - l,y„_i,X„_i, . . . ,yo,^o) 

We refer to the above expression as the almost-expression for case 2. If in the above formula we 
replace APreOddi by APreOdd2 and APreEveni by APreEven2 then we obtain the dual almost- 
expression for case 2. Again, if the dual almost-expression is Wd for T = i/), then Wd Q {s ^ 
5 I Vvri G nf .37r2 G U2. PrJi''^2(coParity(p)) = 1}. 

(b) We have Z C -^Almosti{U , M, Parity (p)), where Z is defined as follows 

52„nPospre2(yn-i) 

U 

B2n^i n PosPreOdd2(0, y„_i, X„_i) 

u 

B2n-2 n PosPreEven2(0, y„_i, X„_2, ^n-2) 

U 

B2n-3 n PosPreOdd2(l, y„_i, X„_i, y„_2, Xn-2) 

B2 n PosPreEven2(n - 2, y„_i, X„_i, . . . , yi, Xi, yo) 

u 

Bi n PosPreOdd2(n - 1, y„_i, X„_i, . . . , Yo,Xo) 
We refer to the above expression as the positive-expression for case 2. 

The comparison to Emerson- Jutla ;U-calculus formula for turn-based games. We compare our fi- 
calculus formula with the /x-calculus formula of Emerson- Jutla IIEJ91I to give an intuitive idea of the con- 
struction of the formula. We first present the formula for Case 2 and then for Case 1 . 

Case 2. For turn-based deterministic games with parity function p : 5 — > [1..2n], it follows from the results 
of Emerson- Jutla IIEJ91I . that the sure- winning (that is equivalent to the almost-sure winning) set for the 



//y„„i.zvX„_i. • • • fj.Yi.uXi.iJ.YoMXo 
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objective Parity (p) U <>T is given by the following /i-calculus formula: 



uYn^i.fiXn-i-- ■ ■ uYi.fiXi.uYo.fiXo 



T 

U 
52nnPrei(y„_i) 

u 

S2n-inPrei(X„_i) 

u 

B2„_2nPrei(y„_2) 

u 

S2„_3nPrei(X„„2) 
S2nPrei(yo) 

u 

SinPrei(Xo) 

The formula for the almost-expression for case 2 is similar to the above /x-calculus formula and is obtained 
by replacing the Prei operators with appropriate APreOddi and APreEveni operators. 

Case 1. For turn-based deterministic games with parity function p : S ^ [0..2n — 1], it follows from the 
results of Emerson- Jutla IIEJ91i . that the sure- winning (that is equivalent to the almost-sure winning) set for 
the objective Parity (p) U OT is given by the following /x-calculus formula: 



flXn-l^Yn-l-^Xn-l- ■ ■ ■ uYi.^Xi.uYq. 





T 






U 




B2n- 


_inPrei(X„) 




U 




B2n- 


2nPre 

u 


1(1;.- 1 


B2n-: 


i n Pre] 

u 


{Xn-l 


B2n- 


4nPre 


l{Yn-2 


Bi 


nPrei 
U 


iXi) 


Be 


nPrei 


(Yo) 



The formula for the almost-expression for case 1 is similar to the above /^-calculus formula and is obtained 
by (a) adding one quantifier alternation uYn, and (b) replacing the Prei operators with appropriate APreOddi 
and APreEveni operators. 

Proof structure. The base case follows from the coBiichi and Biichi case: it follows from the results 
of MdAHOOII since for Biichi and coBiichi objectives, uniform memoryless almost-sure winning strategies 
exist and our /i-calculus formula coincide with the /x-calculus formula to describe the almost-sure winning 
set for Biichi and coBiichi objectives. The proof of induction proceeds in four steps as follows: 

1. Step 1. We assume the correctness of case 1 and case 2, and then extend the result to parity objective 
with parity function p : S 1— )• [0..2n], i.e., we add a max even priority. The result is obtained as follows: 



16 



for the correctness of the almost-expression we use the correctness of case 1 and for complementation 
we use the correctness of case 2. 

2. Step 2. We assume the correctness of step 1 and extend the resuh to parity objectives with parity 
function p : S* i— )■ [1..2n + 1], i.e., we add a max odd priority. The result is obtained as follows: for 
the correctness of the almost-expression we use the correctness of case 2 and for complementation we 
use the correctness of step 1. 

3. Step 3. We assume correctness of step 2 and extend the result to parity objectives with parity function 
p : 5" I— 7- [1..2n + 2]. This step adds a max even priority and the proof will be similar to step 1. The 
result is obtained as follows: for the correctness of the almost-expression we use the correctness of 
step 2 and for complementation we use the correctness of step 1 . 

4. Step 4. We assume correctness of step 3 and extend the result to parity objectives with parity function 
p : 5 1-^ [0..2n + 1]. This step adds a max odd priority and the proof will be similar to step 2. The 
result is obtained as follows: for the correctness of the almost-expression we use the correctness of 
step 1 and for complementation we use the correctness of step 3. 

We first present two technical lemmas that will be used in the correctness proofs. First we define prefix- 
independent events. 

Prefix-independent events. We say that an event or objective is prefix-independent if it is independent 
of all finite prefixes. Formally, an event or objective A is prefix-independent if, for all u,v € S* and 
u € S"^, we have uuj G A iff voo € A. Observe that parity objectives are defined based on the states that 
appear infinitely often along a play, and hence independent of all finite prefixes, so that, parity objectives are 
prefix-independent objectives. 

Lemma 1 (Basic Apre principle). Let X C Y C Z C S and s ^ S be such that Y = X U {s} and 
s G Aprei{Z,X). For all prefix-independent events A '^ o{Z \ Y), the following assertion holds: 

Assume that there exists a uniform memoryless tti € 11^ fl Ilf^ such that for all "Ki € 112 cmd 
for all z & Z \Y we have 

PrJi'^2(^UOr) = 1. 

Then there exists a uniform memoryless tti G IIj;^ fl 11]^ such that for all 7T2 G 112 we have 

Pr^^'^'^iAuoX) = 1. 

Proof. Since s G Apre]^(Z, X), player 1 can play a uniform memoryless distribution ^i at s to ensure that 
the probability of staying in Z is 1 and with positive probability rj > the set X is reached. In Z\y player 1 
fixes a uniform memoryless strategy to ensure that A U OY is satisfied with probability 1. Fix a counter 
strategy 7r2 for player 2. If s is visited infinitely often, then since there is a probability of at least r/ > to 
reach X, it follows that X is reached with probability 1. If s is visited finitely often, then from some point 
on n(Z \ Y) is satisfied, and then A is ensured with probability 1. Thus the desired result follows. I 

Lemma 2 (Basic principle of repeated reachability). Let T (Z S, B <^ S and W <^ S be sets and A be 
a prefix-independent objective such that 

W C AlmostiiU, M, or U 0(3 D Prei{W)) U A). 
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Then 



W C Almosti{U, M, or U nOB U A). 



Proof. Let Z = B n Prei(VF). For all states s ^ W \ {Z U T), there is a uniform memoryless player 1 
strategy vri that ensures that against all player 2 strategies 7r2 we have 

VtI^'^^{0{T\JZ)\JA) =1. 

For all states in Z player 1 can ensure that the successor state is in W (since Prei {W) holds in Z). Consider 
a strategy tt\ as follows: for states s G Z play a uniform memoryless strategy for Prei(H^) to ensure that 
the next state is in W; for states s ^W \{Z \JT) play the uniform memoryless strategy vri. Let us denote 
by OfcZ U <>T to be the set of paths that visits Z at least fc-times or visits T at least once. Observe that 
limfc_>oo {OkZ U OT) C nOB U OT. Hence for all s G VF and for all 7r2 G 112 we have 



Vv7'^''\ 



□ 



0BU0T[JA) > Vvf''"'{oZ[JOTuA)-WVvf''"'{Ok+iZUOTyjA\OkZUOTuA) 



fc=l 



1. 



The desired result follows. 



Correctness of step 1. We now proceed with the proof of step 1 and by inductive hypothesis we will assume 
that case 1 and case 2 hold. 

Lemma 3 For a parity function p : S >—?■ [0..2n], and for all T CI S, we have W C 
Almosti(U, M, Parity (p) U OT), where W is defined as follows: 

T 

U 

B2nr\Prei{Yn) 

U 

B2n-i n APreOddi (0, y„, X„) 

u 

B2n-2 n APreEveni{Q, Y^, X„, y„_i) 

U 

52n-3 n APreOddi{l, y„, X„, Yn-uXn-l) 

u 

B2n~A n APreEveni{l, Yn,Xn, y„_i, X„_i, y„_2) 



uYn-fiXn-vYn-l-flX, 



n—1- 



■ vYi.fiXi.uYQ. 



Bi nAPreOddi{n - 1, y„, X„, . . . , Yi, Xi) 

u 

Bo nAPreEveni{n - 1, Yn, X„, . . . ,Yi,Xi,Yo) 

Proof. We first present the intuitive explanation of obtaining the ^u-calculus formula. 

Intuitive explanation of the fi-calculus formula. The ^u-calculus formula of the lemma is obtained from the 
almost-expression for case 1 by just adding the expression B2n H Prei(y„). 
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To prove the result we first rewrite W as follows: 



uYn.fJ-Xn-iyYn-ll-J-Xn-l ■ ■ ■ uYi.^iXi.vYq. 



ru(B2nnPrei(Ty)) 
u 

B2n-i n APreOddi(0, y„, X„) 

u 

B2n-2 n APreEveni (0, y„, X„, y„_i) 

u 

B2n~z n APreOddi(l, y„, x„, y„_i, X„_i) 

u 

B2n-A n APreEveni(l, y„, X„, y„_i, X„_i, y„_2) 
Si n APreOddi(n - 1, y„, X„, . . . , Yi, Xi) 

u 

So n APreEveni(n - 1, y„, X„, . . . , Fi, Xi, Fo) 

The rewriting is obtained as follows: since W is the fixpoint y„, we replace y„ in the i?2n H Prei(y„) by 
W . Treating T U (i?2n H Prei(H^)), as the set T for the almost-expression for case 1, we obtain from the 
inductive hypothesis that 

W C AlmostiiU, Af, Parity (p) U 0(r U {B2n n Prei{W)))). 

By Lemma|2j with B = i?2n and A = Parity (p) we obtain that 

W C Almosti{U, Af, Parity (p) U OT U aOB2n)- 

Since i?2n is the maximal priority and it is even we have n<>B2n ^ Parity(p). Hence W C 
Almost i(U, M, Parity (p) U OT) and the result follows. I 



Lemma 4 For a parity function p : S >-^ [0..2n], we have Z C -^Almosti{U,M, Parity (p)), where Z is 
defined as follows 

B2nr\Pospre2{Yn) 

u 

B2n^i n PosPreOdd2{0, y„, X„) 

U 

B2n-2 n PosPreEven2{0, y„, X„, y„_i) 

u 

B2n~3 n PosPreOdd2{l, Yn, Xn, Yn-l,Xn-l) 

u 

B2n-4: n PosPreEven2{l, y„, X„, y„_i, X„_i, y„_2) 
Bi n PosPreOdd2{n - 1, y„, X„, . . . , Yi, Xi) 

u 

So n PosPreEven2{n - 1, y„, X„, . . . , Fi, Xi, Yq) 



/iyn-i^Xn-/^^n-l-l^Xn-l- • • • /i^l • Z^Xi . ^Iq • 
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uXn-jJ-Yn-l-iyXn-l- ■ ■ ■ ^iYi.vXi.^Yq. 



Proof. For fc > 0, let Z^ be the set of states of level k in the above //-calculus expression. We will show 
that in Z^ for every memoryless strategy for player 1, player 2 can ensure that either Z^-i is reached with 
positive probability or else coParity(p) is satisfied with probability 1. Since Zq = 0, it would follow by 
induction that Z^ n Almost i {U, M, Parity (p)) = and the desired result will follow. 

We simplify the computation of Zj. given Z^._i and allow that Z^ is obtained from Z^-i in the following 
two ways. 

1. Add a set states satisfying i?2n n Pospre2(.^A,-i)» and if such a non-emptyset is added, then clearly 
against any memoryless stratgy for player 1, player 2 can ensure from Zj. that Z^^i is reached with 
positive probability. Thus the inductive case follows. 

2. Add a set of states satisfying the following condition: 

B2n-i n PosPreOdd2(0, Zk^i,Xn) 

U 

B2n-2 n PosPreEven2(0, Z^^i, X„, y„_i) 

U 

B2n-3 n PosPreOdd2(l, Z^^i, X„, y„_i, X„_i) 

u 

B2n-4 n P0SPreEven2(l, Zk-l,Xn, Yn-l,Xn-l,Yn-2) 

Bi n PosPreOdd2(n - 1, Zfc_i, X„, . . . ,Yi, Xi) 

U 

Bo n PosPreEven2(n - 1, Zk-i,Xn, . . . ,Yi,Xi,Yo) 

If the probability of reaching to Z^^i is not positive, then the following conditions hold: 

• If the probability to reach Z^-i is not positive, then the predicate Pospre2(.^fc-i) vanishes from 
the predecessor operator PosPreOdd2(i, Zk-i,Xn, Yn-i, . . . , Yn-i, Xn-i), and thus the opera- 
tor simplifies to the simpler predecessor operator APreEven2(i — l,Xn, ^n-i, • • • , Yn-i, Xn-i)- 

• If the probability to reach Z^-i is not positive, then the Pospre2(.^A:-i) vanishes from the prede- 
cessor operator PosPreEven2(i, Zfc_i, X„, Yn-i, ■ ■ ■ , Yn-i, Xn-i, Yn-i-i), and thus the opera- 
tor simplifies to the predecessor operator APreOdd2(i, X„, Yn-i, . . . , Yn-i, Xn-i, Yn-i-i)- 

Hence either the probability to reach Z^-i is positive, or if the probability to reach Z^-i is not 
positive, then the above /i-calculus expression simplifies to 

B2„_inPre2(X„) 

U 

B2n-2 n APreOdd2(0, X„, y„_i) 

u 

B2n^3 n APreEven2(l, X„, y„_i, X„_i) 

U 

B2n~4 n APreOdd2(l, x„, y„_i, x„_i, y„_2) 

Bi n APreEven2(n - 2, X„, . . . , Yi,Xi) 

U 

Bo n APreOdd2(n - 1, X„, . . . , Yi,Xi,Yo) 



Z* = uXn-fiYm-iiyXm^i ■ ■ ■ flYi M X i . flYo . 
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We now consider the parity function p+1 : S i— ;■ [1..2n], and observe that the above formula is same as 
the dual almost-expression for case 2. By inductive hypothesis on the dual almost-expression we have 

Z* C {s G 5 I VvTi € nf .37r2 G Hs. PrJi'''2(coParity(p)) = 1} (since Parity (p+1) = coParity(p)). 
Hence the desired claim follows. 

The result follows from the above case analysis. I 

Correctness of step 2. We now prove correctness of step 2 and we will rely on the correctness of step 1 and 
the inductive hypothesis. Since correctness of step 1 follows from the inductive hypothesis, we obtain the 
correctness of step 2 from the inductive hypothesis. 

Lemma 5 For a parity function p : S >—^ [1..2n + 1], and for all T C S we have W C 
Almosti(U, M, Parity (p) U OT), where W is defined as follows: 

T 

U 

B2n+i nAPreOdd^iO, Y^, X^) 

U 

B2n n APreEveni (0, y„, X„, y„_i) 

U 

B2n-i nAPreOddiii, y„, x„, y„_i, X„_i) 
u 

B2n~2 nAPreEveni{l, Yn, X„, y„_i, X„_2, y„_2) 

u 

B2n-3 nAPreOddi{2, y„, X„, Yn-l,Xn-l,Yn-2,Xn-2) 



uYn.jxXn.vYn-l.llXn-l. • • • uYo.fxXo 



B2 n APreEveniin - 1, y„, X„, y„_i, X„_i, . . . ,Yi,Xi,Yo) 

U 
Bi r\APreOddi{n, Yn, X„, y„_i, X„_i, . . . , Fq, ^o) 

Proof. We first present an intuitive explanation about the how the ^u-calculus formula is obtained. 

Intuitive explanation of the fx-calculus formula. The /i-calculus expression is obtained from the almost- 
expression for case 2: we add a uYn.fiXn (adding a quantifier alternation of the ^u-calculus formula), and 
every APreOdd and APreEven predecessor operators are modified by adding Apre]^(y„,X„) |*J with the 
respective predecessor operators, and we add B2n+i H APreOddi(0, Yn,Xn). 
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We first reformulate the algorithm for computing W in an equivalent form. 



W = fiXn.vYn-i.flXn-l. ■ ■ ■ vYq.^Xq 



T 

U 

52n+inAPreOddi(0,W^,X„) 

U 

B2n n APreEveni (0, W, X„ , y„_i) 

U 

B2n~i n APreOddi(l, W, X„, y„_i, X„_i) 

u 

B2n-2 n APreEveni(l, W, X„, y„_i, X„_2, Yn-2) 

U 
S2n_3 n APreOddi(2, w, x„, y„_i, x„_i, y„_2, X„_2) 

B2 n APreEveni (n - 1, W, X„, y„_i, X„_i, . . . , Fi, Xi, Fo) 

u 

Bi n APreOddi (n, W, X„, y„_i , X„_i , . . . , Fq, ^0) 

The reformulation is obtained as follows: since W is the fixpoint of y„ we replace y„ by W everywhere 
in the ^u-calculus formula. The above mu-calculus formula is a least fixpoint and thus computes W as 

the limit of a sequence of sets Wq = T, Wi, W2, At each iteration, both states in i?2n+i and states 

satisfying -B<2n can be added. The fact that both types of states can be added complicates the analysis of 
the algorithm. To simplify the correctness proof, we formulate an alternative algorithm for the computation 
of W; an iteration will add either a single B2n+i state, or a set of B<2n states. 

To obtain the simpler algorithm, notice that the set of variables Yn^i,Xn-i, . . . ,Yq,Xo does not 
appear as an argument of the APreOddi(0, VF,X„) = Apre^(W^, X„) operator. Hence, each B2n+i- 
state can be added without regards to i?<2n-states that are not already in W. Moreover, since the 
uYn-i.fiXn-i- ■ ■ ■ uYo.fiXQ operator applies only to i3<2n-states, i32n+i-states can be added one at a time. 
From these considerations, we can reformulate the algorithm for the computation of W as follows. 

The algorithm computes W as an increasing sequence T = Tq C Ti C T2 C ■ ■ ■ C Tm = W oi states, 
where m > 0. Let Li = Ti\Ti^i and the sequence is computed by computing Tj as follows, for < i < m: 

1. either the set Li = {s} is a singleton such that s € Aprei(VF, Tj_i) n i?2n+i- 

2. or the set Li consists of states in i?<2n such that Li is a subset of the following expression 

B2n n APreEveni (0, W, Ti_i, y„_i) 
U 

B2n-inAFK0ddi{l,W,Ti^l,Yn^l,Xn-l) 

u 

B2n-2 n APreEveni(l, W, Ti_i, y„_i, X„_2, y„„2) 

U 
B2n-3 n APreOddi(2, W, T^.i, y„_i, X„_i, y„_2, X„_2) 

B2 n APreEveni (n - 1, W, T^^i, y„_i, X^-i, . . . ,Yi,Xi,Yo) 

u 

Bi n APreOddi(n, W, T,_i, y„_i, X„_i, . . . , Yo,Xo) 



vYn-l-llXn-l- ■ ■ ■ vYq.^iXq 
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The proof that W C Almosti{U, M, Parity (p) U OT) is based on an induction on the sequence T = Tq C 
Ti C T2 C ■■■ C Tm = W. For I < i < m, let Vi = W \ Tm-i, so that Vi consists of the last block of 
states that has been added, V2 to the two last blocks, and so on until Vm = W . We prove by induction on 
i E {1, . . . , m\, from i = lioi = m, that for all s G Vi, there exists a uniform memoryless strategy vri for 
player 1 such that for all 1^2 € 112 we have 

Pr^i'"2(^j;^_.UParity(p)) = 1. 

Since the base case is a simplified version of the induction step, we focus on the latter. There are two 
cases, depending on whether Vi \ Vi^i is composed of B2n+i or of i3<2n-states. Also it will follow from 
Lemma[TT]that there always exists uniform distribution to witness that a state satisfy the required predecessor 
operator. 

• If Vi \ Vi_i C B2n+i, then Vi \ Vi_i = {s} for some s £ S and s E Apre^(VF, Tm~i)- The result 
then follows from the application of the basic Apre principle (Lemma[Tll with Z = W, X = Tm-i, 
Z \Y = Vi-i and A = Parity (p). 

• If Vi \ Vi_i C B<2n, then we analyze the predecessor operator that s £Vi\ Vi_i satisfies. The prede- 
cessor operator are essentially the predecessor operator of the almost-expression for case 2 modified 
by the addition of the operator Apre^(T^, Tm-i)l*J. If player 2 plays such the Apre]^(W, Tm_i) part of 
the predecessor operator gets satisfied, then the analysis reduces to the previous case, and player 1 can 
ensure that T^-i is reached with probability 1. Once we rule out the possibility of Apre]^(W, Tm-i), 
then the //-calculus expression simplifies to the almost-expression of case 2, i.e., 

52„nPrei(y„_i) 

u 

B2n-i n APreOddi(0, y„_i, X„_i) 

u 

B2n-2 n APreEveni(0, y„_i, X„_2, ^n-2) 

u 

B2n-z n APreOddi(l, y„_i, X„_i, y„_2, ^n-2) 



uYn-l.^iXn-l. ■ ■ ■ uYo.flXo 



B2 n APreEvem (n - 2, y„_i , X„„i , . . . ,Yi,Xi,Yo) 

u 

Si n APreOddi(n - l,y„_i,X„_i, . . .,Yo,Xo) 

This ensures that if we rule out Apre^(lV^, T^-i) form the predecessor operators, then by induc- 
tive hypothesis (almost-expression for case 2) we have Li C Almosti{U,M,Faiity{p)), and if 
Apre^ (W,Tm_i) is satisfied then Tm-i is ensured to reach with probability 1. Hence player 1 can 
ensure that for all s G Vi, there is a uniform memoryless strategy tti for player 1 such that for all tt2 
for player 2 we have 

Prr'"'(0T„-iUParity(p)) = l. 

This completes the inductive proof. With i = m v/e obtain that there exists a uniform memoryless strategy 
vTi such that for all states s e Vm = W and for all 7r2 we have Pr^i'''2(C>To U Parity (p)) = 1. Since Tq = T, 
the desired result follows. I 
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Lemma 6 For a parity function p : S >—?■ [1..2n + 1] we have Z C ^Almosti{U,M, Parity (p)), where Z is 
defined as follows: 

B2„+i n PosPreOdd2 (0, y„ , X„) 

u 

B2n n PosPreEven2{Q, Yn,Xn, ^n-l) 

u 

B2n-i n PosPreOdd2{l, !"„, X„, y„_i, X„_i) 

U 

-B2n-2 n PosPreEven2{l, ¥„, X„, y„_i, X„_2, ^n-2) 

U 

B2n-3 n PosPreOdd2{2, y„, x„, y„_i, x„_i, y„_2, ^n-2) 



^y„.z/X„./iy„„i.i/X„_i. • • • hYqmXq 



B2 n PosPreEven2{n - 1, y„, X„, y„_i, X„_i, . . . , yi, Xi, yo) 

u 

Si n PosPreOdd2{n, y„, X„, y„_i, X„_i, ...,Yo, Xo) 

Proof. For k > 0, let Zk be the set of states of level k in the above ^u-calculus expression. We will show that 
in Zk player 2 can ensure that either Zj^^i is reached with positive probability or else coParity(p) is satisfied 
with probability 1. Since Zq = 0, it would follow by induction that Zk Ci Almosti {U, M, Parity (p)) = and 
the desired result will follow. 

We obtain of Z^ from Zk-i as follows: 

B2n+i n PosPreOdd2(0, Zk-i,Xn) 

U 

B2n n PosPreEven2(0, Z^.i, X„, Yn-i) 

U 

B2n-i n PosPreOdd2(l, Zfc_i, X„, y„„i, X„„i) 

u 

-B2„-2 n PosPreEven2(l, Zfe_i, X„, y„_i, X„_2, ^n-2) 

U 
B2„_3 n PosPreOdd2(2, Zfc_i, X„, y„_i, X„_i, y„_2, Xn-2) 



uXn.fiYn-i.uXn-l. ■ ■ ■ IjYq.vXq 



B2 n PosPreEven2(n - 1, Zfc_i, X„, y„_i, X„_i, . . . ,Yi,Xi,Yq) 

u 

Bi n PosPreOdd2(n, Zfc_i, X„, y„_i, X„_i, . . . ,Yq, Xq) 

If player 1 risks into moving to Z^^i with positive probability, then the inductive case is proved as Z^-i is 
reached with positive probability. If the probability of reaching to Z^-i is not positive, then the following 
conditions hold: 

• If the probability to reach Zk-i is not positive, then the predicate Pospre2(.^fc-i) vanishes from the 
predecessor operator PosPreOdd2(i, Zfc_i, X„, Y^-i, ■ ■ ■ , Yn-i, Xn-i), and thus the operator simpli- 
fies to the simpler predecessor operator APreEven2(i — 1, X„, y„_i, . . . , Yn-i, Xn-i)- 

• If the probability to reach Z^-i is not positive, then the Pospre2(Zfc_i) vanishes from the predecessor 
operator PosPreEven2(i, Zk-i,Xn, Yn~i, ■ ■ ■ , Yn-i, Xn-i,Yn-i-i), and thus the operator simplifies 
to the predecessor operator APreOdd2(i, Xn, Yn-i, ■ ■ ■ , Yn-i, Xn-i,Yn-i-i). 
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Z* = l^Xn-fiYn-l-l^X, 



n-1- 



Hence either the probabiUty to reach Zk-i is positive, or the probability to reach Z^-i is not positive, then 
the above /i-calculus expression simplifies to 

B2n+iriPre2{Xn) 

u 

B2n n APreOdd2(0, X„, y„_i) 

u 

B2n-i n APreEven2(0, X„, y„_i, X„_i) 
U 
■ fiYo.uXo B2n-2 n APreOdd2(l, X„, y„_i, X„_2, >"n-2) 

u 

B2n-3 n APreEven2(l, X„, Yn-l, Xn-l,Yn-2, Xn^2) 

B2 n APreOdd2(n - 1, X„, y„_i, X„_i, . . . ,Yi, Xi,Yo) 

U 
Bi n APreEven2(n - 1, X„, y„_i, X„_i, . . . , Fq, ^0) 

We now consider the parity function p — I : 5 H- [0..2n] and by the correctness of the dual almost- 
expression for step 1 (Lemma [3]) (with the roles of player 1 and player 2 exchanged and player 2 plays 
against memoryless strategies for player 1, as in Lemma|4l) we have Z* C {s E 5 | Vvri € n^.37r2 S 
112. PrJi''^2(coParity(p)) = 1} (since coParity(p) = Parity(p — 1)). Hence the result follows. I 



Correctness of step 3. The correctness of step 3 is similar to correctness of step 1 . Below we present the 
proof sketches (since they are similar to step 1). 

Lemma 7 For a parity function p : S >-^ [1..2n + 2], and for all T C S, we have W C 
Almosti(U, M, Parity{p) U OT), where W is defined as follows: 

T 

U 
B2n+2r\Prei{Yn) 

u 

B2n+i nAPreOddi{0, y„, X„) 

U 

B2n n APreEveni (0, y„, X„, y„_i) 

u 

B2„- 1 n APreOddi ( 1 , y„ , X„ , y„_ 1 , X„_ 1 ) 

u 

B2n-2 nAPreEveniil, Yn, Xn, y„_i, X„_2, ^n-2) 

u 

B2n^3 n APreOddi (2, y„ , X„ , y„_i , X„_i , y„_2 , ^n-2) 



Yi,Xi,Yo[ 



vYn-UXn-vYn-l-llXn-l- ■ ■ ■ uYo.fiXo 



B2 n APreEveni (n - 1 , y„ , X„ , y„„i , Xn-i, ..., 

u 

Bi riAPreOddiin, Yn, Xn, y„_i, X„_i, ...,Yo,Xo 
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flYn-uXn-^J-Yn-l-iyXn^l. ■ ■ ■ flYo.l^Xo 



Proof. The proof is almost identical to the proof of Lemma [3] Similar to step 1 (Lemma [S]), we add a 
max even priority. The proof of the result is essentially identical to the proof of Lemma [3] (almost copy- 
paste of the proof), the only modification is instead of the correctness of the almost-expression of case 1 
we need to consider the correctness of the almost-expression for step 2 (i.e., Lemma |5] for parity function 

p : S ^ [l..2n + 1]). I 

Lemma 8 For a parity function p : S i— )• [1..2n + 2] we have Z C ^Almosti{U,M, Parity (p)), where Z is 
defined as follows: 

B2n+2^Pospre2{Yn) 

u 

B2n+i n PosPreOdd2{0, y„, X„) 

u 

B2n n PosPreEven2{0, Yn,Xn, y„-i) 

U 

B2n-ir) PosPreOdd2 ( 1 , y„ , X„ , y„„ i , X„_ i ) 

U 

B2n-2 n PosPreEven2{l, Yn, Xn, Yn-l,Xn-2,Yn-2) 

U 

B2n-3 n PosPreOdd2i2, Yn,Xn, Yn^l,Xn-l,Yn^2,Xn-2) 

B2 n PosPreEven2{n - 1, !"„, X„, y„_i, X„_i, . . . ,Yi,Xi,Yo) 

U 
Bi n PosPreOdd2{n, y„, X„, y„_i, X„_i, . . . , Fq, ^0) 

Proof. The proof of the result is identical to the proof of Lemma |4] (almost copy-paste of the proof), the 
only modification is instead of the correctness of the almost-expression of case 2 we need to consider the 
correctness of the almost-expression for step 1 (i.e., Lemma[3l). This is because in the proof, after we rule out 
states in B2n+2 and analyze the sub-formula as in Lemma[3l we consider parity function p — 1 : S 1-^ [0..2n] 
and then invoke the correctness of Lemma [3] I 

Correctness of step 4. The correctness of step 4 is similar to correctness of step 2. Below we present the 
proof sketches (since they are similar to step 2). 

Lemma 9 For a parity function p : S >-^ [0..2n + 1], and for all T CL S, we have W C 
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Almosti{U, M,Parity{p) U <>T), where W is defined as follows: 



uYn+l.fJ.Xn+1. ■ ■ ■ lyYi.fiXi.uYo. 



T 

u 

B2n+i n APreOddi (0, y„+i , X„+i) 

U 

B2n n APreEveni (0, Yn+i , X„+i , y„) 

U 

S2n-i nAPreOddi{l,Yn+i,Xn+i,Yn,Xn) 

u 
-B2n-2 n APr£'£'v£'?ii(i, y„+i, x„+i, y„, x„, y„_i) 

u 
52„_3 n A/'reOfifJi(2, y„+i, x„+i, y„, Xn, y„-i, x„_i) 

u 
S2n_4 n APre£'ve?ii(2, y„+i, x„+i, y„, x„, y„_i, x„_i, y„_2) 

Si n APreOddi {n,Yn+i,Xn+i,Yn,Xn,...,Yi,Xi) 

u 

So n APreEveni{n, y„+i, X„+i, y„, X„, . . . , yi, Xi, yo) 

Proof. Similar to step 2 (Lemma [5]l, we add a max odd priority. The proof of the result is essentially 
identical to the proof of Lemma [5] (almost copy -paste of the proof), the only modification is instead of the 
correctness of the almost-expression of case 2 we need to consider the correctness of the almost-expression 
for step 1 (i.e., Lemma[3]for parity function p : S ^-^ [0..2n]). I 

Lemma 10 For a parity function p : S >—?■ [0..2n + 1] we have Z C ^Alntosti(U, AI,Parity{p)), where Z 
is defined as follows: 

B2n+i n PosPreOdd2{0, y„+i, X„+i) 

u 

B2n n PosPreEven2 (0, y„+i , X„+i , y„) 

u 

B2n-i n PosPreOdd2{l, y„+i, X„+i, y„, X„) 

u 

B2n-2 n PosPreEven2il, y„+i, X„+i, y„, X„, y„_i) 

u 

B2n-3 n PosPreOdd2{2, y„+i, X„+i, y„, Xn, Yn-l,Xn-l) 

u 
B2n-i n PosPreEven2{2, y„+i, x„+i, y„, x„, y„_i, X„_i, y„_2) 



^Yn+i.vXn+i- ■ ■ ■ IJ.Yi.uXi.llYo. 



Bi n PosPreOdd2in, y„+i, X„+i, y„, X„, . . . , Yi,Xi) 

u 

Bo n PosPreEven2{n, y„+i, X„+i, y„, X„, . . . , yi, Xi, yo) 

Proof. The proof of the result is identical to the proof of Lemma [6] (almost copy-paste of the proof), the 
only modification is instead of the correctness of the almost-expression of step 1 (Lemma [S]) we need to 
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consider the correctness of the almost-expression for step 3 (i.e., Lemma |7]l. This is because in the proof, 
while we analyze the sub-formula as in Lemma|71 we consider parity function p + 1 : S i-^ [l..2n + 2] and 
then invoke the correctness of Lemma |7] I 

Observe that above we presented the correctness for the almost-expressions for case 1 and case 2, and 
the correctness proofs for the dual almost-expressions are identical. We now present the duality of the 
predecessor operators. We first present some notations required for the proof. 

Destination or possible successors of moves and distributions. Given a state s and distributions ^i G 

Xf and ^2 G X2 we denote by Dest{s, ^1,^2) = {t e S \ P2^'^'^{t) > 0} the set of states that have 
positive probability of transition from s when the players play ^1 and ^2 at s. For actions a and b we have 
Dest{s, a,b) = {t £ S \ d{s, a, b){t) > 0} as the set of possible successors given a and b. For A C ri(s) 
and B C r2(s) we have Dest{s, A, B) = UaeA beB Dest{s, a, b). 

Lemma 11 (Duality of predecessor operators). The following assertions hold. 

1. Given Xn C X„_i C • • • C X„_j C Yn-i ^ l^,_j+i ^ • • • C Yn, we have 

PosPreOdd2{i, -^Yn, ^Xn, ■■■ , -^Yn-i, ^Xn-i) = -^APreOddi{i, Yn,Xn, ■■■ , Yn-i,Xn-i). 

2. Given Xn C X„_i C • • • C X„_j C Yn^i-i C Yn-i C Yn-i+i '^ ■■■ QYn,we have 

PosPreEven2 (i, -^Yn, -^Xn, ■■■, -Yn-i, ^Xn-i^-Yn-i-l) 

= ^APreEveni{i, Yn, Xn, ■■■, Yn-i,Xn^i, l^n-i-i)- 

3. For all s € S, if s G APreOddi{i,Yn,Xn, . . . ,Yn-i,Xn-i) (resp. s G 
APreEveni{i,Yn,Xn, ■ ■ ■ ,Yn-i,Xn-i,Yn-i-i)), then there exists uniform distribu- 
tion ^1 to witness that s € APreOddi{i,Yn,Xn,---,Yn-i,Xn~i) (resp. s G 
APreEveni{i, Yn,Xn, ■■■ , Yn-i,Xn-i, Yn-i-i)). 

Proof. We present the proof for part 1 , and the proof for second part is analogous. To present the proof 
of the part 1, we first present the proof for the case when n = 2 and i = 2. This proof already has all the 
ingredients of the general proof. After presenting the proof we present the general case. 

Claim. We show that for Xi C Xq C yo C Yi we have 

Pospre2(-ri)yApre2(-Xi, -yo) WPre2(-Xo) = -(Aprei(yi,Xi)l*jAprei(yo,Xo)). 
We now present the following two case analysis for the proof. 

1. A subset U C Ti{s) is good if both the following conditions hold: 

(a) Condition 1. For all b G ^2{s) and for all a € U we have Dest{s,a,b) C Yi (i.e., 
Dest{s,U,b) C Yi);and 

(b) Condition 2. For all b G r2(s) one of the following conditions hold: 

i. either there exists aGlI such that Dest{s, a,b)riXi / (i.e., Dest{s, U, b)riXi / 0); or 
ii. for all a G t/ we have Dest{s, a, b) C Yq (i.e., Dest{s, U, b) C Yq) and for some a G U v/e 
have Dest{s, a, 6) n Xq 7^ (i.e., Dest{a, U, 6) n Xq / 0). 
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We show that if there is a good set U, then s G Apre^ (Yi , Xi ) |*J Aprei{Yo, Xq). Given a good set 
U, consider the uniform distribution ^i that plays all actions in U uniformly at random. Consider an 
action b € r2(s) and the following assertions hold: 

(a) By condition 1 we have Dest{s, £,i,b) C y^. 

(b) By condition 2 we have either (i) Dest{s,^i,b) H Xi ^ (/} (if condition 2. a holds); or 
(ii) Dest{s,^i,b) C Yq, and Dest{s,^i,b) n Xq ^ $ (if condition 2.b holds). 

It follows that in all cases we have (i) either Dest{s,^i,b) C Y^ and Dest{s,^i,b) fl Xi 7^ 0, or 
(ii) Dest{s,S,i,b) C Yq and Dest{s,^i,b) n Xq / 0. It follows that ^1 is a uniform distribution 
witness to show that s € Apre^ {Yi , Xi ) |*J Apre^ {Yq ,Xq). 

2. We now show that if there is no good set U, then s € Pospre2(-'yi)|*jApre2(-'Xi, -'yo)l*JP''^2(~'-^o)- 
Given a set U, if U is not good, then (by simple complementation argument) one of the following 
conditions must hold: 

(a) Complementary Condition 1. There exists b € T2{s) and a e U such that Dest{s, a, b) H -Yi ^ 
0;or 

(b) Complementary Condition 2. There exists b € ^2{s) such that both the following conditions 
hold: 

i. for all a € f7 we have Dest{s, a, b) C -1X1; and 

ii. there exists a ^ U such that Dest{s, a, b) n -iYq / or for all a G U we have 
Dest{s,a,b) C -^Xq. 

Since there is no good set, for every set U C ri(s), there is a counter action b = c{U) G '^2{s), 
such that one of the complementary conditions hold. Consider a distribution ^1 for player 1, and 
let U = Supp(^i). Since U is not a good set, consider a counter action b = c{U) satisfying the 
complementary conditions. We now consider the following cases: 

(a) If complementary condition 1 holds, then Dest{s, ^1,6) fl -lYi ^ (i.e., Pospre2(-'yi) is satis- 
fied). 

(b) Otherwise complementary condition 2 holds, and by 2.a we have Dest{s, ^1,6) C -1X1. 

i. if there exists a e U such that Dest{s,a,b) D -^Yq / 0, then Dest{s,^i,b) D -^Yq / 

(hence Apre2(-'Xi, -'Yq) holds); 
ii. otherwise for all a £ U we have Dest{s, a, b) C -iXq, hence Dest{s, S,i,b) C -^Xq (hence 
Pre2(-Xo) holds). 

The claim follows. 

General case. We now present the result for the general case which is a generalization of the previous case. 
We present the details here, and will omit it in later proofs, where the argument is similar. Recall that we 
have the following inclusion: Xn ^ X„_i C . . . C Xn-i C Yn~i C . . . Yn-i C Yn. 

1. A subset U C ri(s) is good if both the following conditions hold: for all b G r2(s) 

(a) Condition 1. For all a G f^ we have Dest{s, a, b) C y„ (i.e., Dest{s, U, b) C y„); and 
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(b) Condition 2. There exists < j < i, such that for all a € [/ we have Dest{s, a, h) C Yn-j 
(i.e., Dest{s,U,b) C y„_j), and for some a ^ U we have Dest{s,a,b) n X„_j / (i.e., 
Dest{s,U,b)nXn-j 7^0). 

We show that if there is a good set U, then s € Apre]^(i, y„, X„, . . . , Yn-i, Xn-i)- Given a good set 
U, consider the uniform distribution ^i that plays all actions in U uniformly at random. Consider an 
action b € T2{s) and the following assertions hold: 

(a) By condition 1 we have Dest{s,^i,b) C y„. 

(b) By condition 2 we have for some < j < i, we have Dest{s, ^i , 6) C Yn-j, and Dest{s, ^i,b)r\ 
Xn-j / (i.e., Apre^{Yn-j,Xn-j) holds). 

It follows that ^1 is a uniform distribution witness to show that s G Apre]^(y„, X„, . . . , Yn-i,Xn~i)- 

2. We now show that if there is no good set U, then s € PosPreOdd2(i, -^Yn, ^Xn, . . . , -iy„_j, -iX„_j). 
Given a set U, if U is not good, then we show that one of the following conditions must hold: there 
exists b G T2{s) such that 

(a) Complementary Condition 1 (CCl). Dest{s, U, b) fl -il^ ^ 0; or 

(b) Complementary Condition 2 (CC2). there exists < j < i such that Dest{s,U,b) C -iXn-j 
and Dest{s, U, b) n -^Yn-j-i / 0; or 

(c) Complementary Condition 3 (CCS). Dest{s, U, b) C -iX„__j. 

Consider a set U that is not good, and let b be an action that witness that U is not good. We show that 
b satisfies one of the complementary conditions. 

• If Dest{s,U,b) n -iy„ 7^ 0, then we are done as CCl is satisfied. Otherwise, we have 
Dest{s, U, b) C Yn, then we must have Dest{s, U, b) C -iX„ (otherwise the action b would sat- 
isfy the condition Dest{s, U, b) C Yn and Dest{s, U, b) fl Xn / 0, and cannot be a witness that 
U is not good). Now we continue: if Dest{s, U, b) n -'l^n-i 7^ 0» then we are done, as we have 
a witness that Dest{s, U, b) C -,X„ and Dest{s, U, b) n -^Yn-i 7^ 0. If Dest{s, U, b) C Yn-i, 
then again since b is witness to show that U is not good, we must have Dest{s, U, b) C -^Xn-i- 
We again continue, and if we have Dest{s, U, b) n -^Yn-2 7^ 0» we are done, or else we continue 
and so on. Thus we either find a witness < j < i to satisfy CC2, or else in the end we have 
that Dest{s, U, b) C ^X„_i (satisfies CC3). 

Since there is no good set, for every set U C ri(s), there is a counter action b = c{U) G r2(s), 
such that one of the complementary conditions hold. Consider a distribution ^1 for player 1, and 
let U = Supp(^i). Since U is not a good set, consider a counter action b = c{U) satisfying the 
complementary conditions. We now consider the following cases: 

(a) If CCl 1 holds, then Dest{s,U,b) n ^y„ 7^ (hence also Dest{s,^i,b) n ^y„ ^ 0) (i.e., 
Pospre2(-'yn) is satisfied). 

(b) Else if CC2 holds, then for some < j < i and we have Dest{s,U,b) C -iXn-j and 
Dest{s,U,b) C Yn-j-i (hence also Dest{s,$,i,b) C -iXn-j and Dest{s,$,i,b) C Yn-j-i) 
(i.e., Apre2(^X„, ^y„_i)i*jApre2(^X„_i, -^Yn-2)\S ■ ■ ■ i*jApre2(^X„_i+i, -^Ya-i) holds). 

(c) Otherwise CC3 holds and we have Dest{s,U,b) C -iXn-i, (hence also Dest{s,^i,b) C 
^Xn-i) (i.e., Pre2(-'X„_i) holds). 
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The claim follows. 

The result for part 3 follows as in the above proofs we have always constructed uniform witness distri- 
bution. I 

Characterization of Almosti{U, M,^) set. From Lemmas [3]— fTOl and the duality of predecessor oper- 
ators (Lemma [TT]) we obtain the following result characterizing the almost-sure winning set for uniform 
memoryless strategies for parity objectives. 

Theorem 3 For all concurrent game structures Q over state space S, for all parity objectives Parity (p) for 
player 1, the following assertions hold. 

1. Ifp : S I— >■ [0..2n — 1], then Almosti{U , M,Parity{p)) = W, where W is defined as follows 

B2n-i n APreOddiiO, Y^, X„) 

U 
B2n-2 r\APreEveni{0, y„, X„, y„_i) 

u 

B2n-3 nAPreOddi{l, Yn,Xn, y„_i, X„_i) 

u 

B2n-4r]APreEveni{l, y„, X„, y„_i, X„_i, y„_2) 



uYn./J.Xn.l'Yn-l.lJ-Xn-l. ■ ■ ■ uYi.fiXi.uYQ. 



Bi n APreOddiin - 1, F^, X„, . . . , Yi.Xi) 

U 

Bq n APreEveni {n - l,Yn,Xn, . . . ,Yi,Xi,Yo) 

and Bi = p^^{i) is the set of states with priority i,for i G [0..2n — 1]. 
2. Ifp : S >—^ [1..2n], then Almosti{U, M,Parity(p)) = W, where W is defined as follows 

B2nr\Prei{Yn-i) 

U 

S2„_i r\APreOddi{Q, Yn-i,Xn-i) 

U 

B2n-2 nAPreEveni{0, y„_i, X„_2, l"n-2) 

U 

B2n-3nAPreOddi{l, y„^i, X„_i, y„_2, ^n-2) 

B2 n APreEveni (n - 2, Yn-i, X„_i , . . . ,Yi,Xi,Yo) 

U 
Bi n APreOddiin - 1, y„_i, X„_i, . . . , Yq^Xq) 

and Bi = p^^{i) is the set of states with priority i,for i G [1..2n]. 



(1) 



uYn-l-llXn-l- ■ ■ ■ vYi.hXi.vYq.IxXo 



(2) 



3. The set Almosti (U, M, Parity {p)) can be computed symbolically using the expressions ([7]) and ([2]) in 
time 0(|5|2"+i . ^^^^2iriWur2W|)_ 

4. Given a state s €z S whether s € Almosti {U, M, Parity (p)) can be decided in NP D coNP. 
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Figure 1 : Three priority concurrent game 

Ranking function for /^-calculus formula. Given a ^u-calculus formula of alternation-depth (the nesting 
depth of i/-/i-operators), the ranking function maps every state to a tuple of d-integers, such that each integer 
is at most the size of the state space. For a state that satisfies the /x-calculus formula the tuple of integers 
denote iterations of the ^u-calculus formula such that the state got included for the first time in the nested 
evaluation of the /x-calculus formula (for details see |EJ91ilKoz83i ). 

The NP n coNP bound follows directly from the //-calculus expressions as the players can guess the 
ranking function of the /i-calculus formula and the support of the uniform distribution at every state to 
witness that the predecessor operator is satisfied, and the guess can be verified in polynomial time. Observe 
that the computation through /i-calculus formulas is symbolic and more efficient than enumeration over the 
set of all uniform memoryless strategies of size ©(J^^g^. iTi (s) U r2(s) |) (for example, with constant action 
size and constant d, the /i-calculus formula is polynomial, whereas enumeration of strategies is exponential). 
The /x-calculus formulas of fEJQll can be obtained as a special case of the /i-calculus formula of Theorem [3] 
by replacing all predecessor operators with the Prei predecessor operator. 

Proposition 3 Almosti {IP, FM, $) = Almosti{U, FM, $) = Almosti{U, M, $). 

Proof. Consider a finite-memory strategy that is almost-sure winning. Since it is finite-memory, it must be 
finite-precision. The result follows from Proposition [2l I 

It follows from above that uniform memoryless strategies are as powerful as finite-precision infinite- 
memory strategies for almost-sure winning. We now show that infinite-precision infinite-memory strategies 
are more powerful than uniform memoryless strategies. 

Example 2 {Almosti{U, M, <I>) C Almosti{IP , IM, <!>)). We show with an example that for a concurrent 
parity game with three priorities we have Almosti{U, M, <I>) C Almosti{IP , IM, <l>). Consider the game 
shown in Fig[I] The moves available for player 1 and player 2 at sq is {a, b} and {c, d}, respectively. The 
priorities are as follows: p{so) = l,p{s2) = 3 and p(si) = 2. In other words, player 1 wins if si is 
visited infinitely often and S2 is visited finitely often. We show that for all uniform memoryless strategy 
for player 1 there is counter strategy for player 2 to ensure that the co-parity condition is satisfied with 
probability 1. Consider a memoryless strategy vri for player 1, and the counter strategy 7r2 is defined as 
follows: (i) if 6 € Supp(7ri(so)), then play d, (ii) otherwise, play c. It follows that (i) if 6 € Supp(7ri(so)), 
then the closed recurrent set C of the Markov chain obtained by fixing vri and tt2 contains S2, and hence 
S2 is visited infinitely often with probability 1 ; (ii) otherwise, player 1 plays the deterministic memoryless 
strategy that plays a at sq. and the counter move c ensures that only sq is visited infinitely often. It follows 
from our results that for all finite-memory strategies for player 1 , player 2 can ensure that player 1 cannot 
win with probability 1. 

We now show that in the game there is an infinite-memory infinite-precision strategy for player 1 to win 
with probability 1 against all player 2 strategies. Consider a strategy vri for player 1 that is played in rounds, 
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Figure 2: Biichi games 

and a round is incremented upon visit to {si, S2}, and in round k the strategy plays action a with probability 
1 — 2FFT ^iid ^ with probability gfcTT- For ^ > 0, let £k denote the event that the game gets stuck at round 
k. In round k, against any strategy for player 2 in every step there is at least probability rik = gFPT > to 
visit the set {si, 82}- Thus the probability to be in round k for £ steps is at most (1 — rj^Y, and this is as ^ 
goes to cxo. Thus we have Fi^^'^^{£k) = 0. Hence the probability that the game is stuck in some round k is 

k>0 k>0 

where the last equality follows as the countable sum of probability zero event is zero. It follows that 
Pr^^''^^{nO{si, S2}) = 1, i.e., {si, 82} is visited infinitely often with probability 1. To complete the proof 
we need to show that {52} is visited infinitely often with probability 0. Consider an arbitrary sti^ategy for 
player 2. We first obtain the probability Uk+i that S2 is visited k + 1 times, given it has been visited k times. 
Observe that to visit S2 player 2 must play the action d, and thus 

1/11 

where in the infinite sum is obtained by considering the number of consecutive visits to si before S2 is 
visited. The explanation of the infinite sum is as follows: the probability to reach S2 for k + 1-th time after 
the A;-th visit (i) with only one visit to si is 2^' (ii) with two visits to si is ^^ (as the probability to play 
action b is halved), (iii) with three visits to si is -^ and so on. Hence we have u^^i < i. The probability 
that S2 is visited infinitely often is Y[T=o ^fc+i < Ilfc^o W^ ~ ^" ^^ follows that for all strategies 7r2 we 
have Prji'''2(n^{s2}) = 0, and hence Pr'^^'"'^ {n<>{si} n On{si,so}) = 1- Thus we have shown that 
player 1 has an infinite-memory infinite-precision almost-sure winning strategy. I 

Examples (Li»hYi(/P,FM,$) C Limiti{IP,IM,^)). We show with an example that 

Limiti{IP, FM, $) C Limiti{IP, IM , ^). The example is from lldAHOOl and we present the details for 
the sake of completeness. 

Consider the game shown in Fig. [2] The state S2 is an absorbing state, and from the state si the next 
state is always sq. The objective of player 1 is to visit si infinitely often, i.e., nO{si}. For e > 0, we will 
construct a strategy vrf for player 1 that ensures si is visited infinitely often with probability at least 1 — e. 
First, given e > 0, we construct a sequence of Sj, for i > 0, such that Si > 0, and flii^ ~ ^i) ^ (1 ~ ^)- L^t 
TT^' be a memory less strategy for player 1 that ensures sq is reached from si with probability at least 1 — £»; 
such a strategy can be constructed as in the solution of reachability games (see lldAHK07l ). The strategy 
irf is as follows: for a history w ^ S* (finite sequence of states), if the number of times si has appeared in 
w is i, then for the history w ■ sq the strategy vrf plays like 7r^\ i.e., TTf{w ■ sq) = 7r^'(so). The strategy vTg 
constructed in this fashion ensures that against any strategy 7r2, the state si is visited infinitely often with 
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probability at least Ylii^ — ^i) > ^ — £■ However, the strategy vrf counts the number of visits to si, and 
therefore uses infinite memory. 

We now show that the infinite memory requirement cannot be avoided. We show now that all finite- 
memory strategies visit S2 infinitely often with probability 0. Let vr be an arbitrary finite-memory strategy 
for player 1, and let M be the (finite) memory set used by the strategy. Consider the product game graph 
defined on the state space {sq, si, S2} x M as follows: for s G {sq, si, S2} and m £ M, let iTu{s, m) = mi 
(where tTu is the memory update function of vr), then for ai G ri(s) and &i G ^2{s) we have 

-=,, , u \( ' '\ f <5(s,ai,6i)(s') m' = mi 
5((s,m),ai,6i)(s ,m) = < ^ 

L otherwise 

where 5 is the transition function of the product game graph. The strategy vr will be interpreted as 
a memoryless vf in the product game graph as follows: for s G {-soi ■81,52} and m G M we have 
7r((s, m)) = 7r„((s, m)), where vr„ is the next move function of vr. Consider now a strategy vr2 for player 2 
constructed as follows. From a state (sq, m) G {sq, si, S2} x M, if the strategy vf plays a with probability 1, 
then player 2 plays c with probability 1, ensuring that the successor is {sQ,m') for some m' G M. If vf 
plays b with positive probability, then player 2 plays c and d uniformly at random, ensuring that {s2,m') is 
reached with positive probability, for some m' G M. Under vri , vr2 the game is reduced to a Markov chain, 
and since the set {52} x M is absorbing, and since all states in {sq} x M either stay safe in {sq} x M or 
reach {52} x M in one step with positive probability, and all states in {si} x M reach {sq} x M in one 
step, the closed recurrent classes must be either entirely contained in {sq} x M, or in {52} x M. This shows 
that, under vri, vr2, player 1 achieves the Biichi goal nolsi} with probability 0. I 

4 Infinite-precision Strategies 

The results of the previous section already characterizes that for almost-sure winning infinite-precision 
finite-memory strategies are no more powerful than uniform memoryless strategies. In this section we 
characterize the limit-sure winning for infinite-precision finite-memory strategies. We define two new oper- 
ators, Lpre (limit-pre) and Fpre (fractional-pre). For s £ S and X,Y C S, these two-argument predecessor 
operators are defined as follows: 

Lprei(y,X) = {s G 5 I Va > . 36 G x? • V6 e X2 ■ [Pt^HX) > a ■ Pt'^'{^Y)]}; (3) 

Fpre2(X, y) = {s G 5 1 3/3 > . Vei G X? ■ 36 G Xl • [Pl''^'{y) > P ' P^^^H^X)] } . (4) 

The operator Lpre^ {Y, X) is the set of states such that player 1 can choose distributions to ensure that the 
probability to progress to X can be made arbitrarily large as compared to the probability of escape from Y. 
In other words, the probability to progress to X divided by the sum of the probability to progress to X and 
to escape Y can be made arbitrarily close to 1 (in the limit 1). The operator Fpre2(X, Y) is the set of states 
such that against all player 1 distributions, player 2 can choose a distribution to ensure that the probability 
to progress to Y can be made greater than a positive constant times the probability of escape from X, (i.e., 
progress to y is a positive fraction of the probability to escape from X). 

Limit-sure winning for memoryless strategies. The results of lldAHK07ll shows that for reachability 
objectives, memoryless strategies suffices for limit-sure winning. We now show with an example that limit- 
sure winning for Biichi objectives with memoryless strategies is not simply limit-sure reachability to the 
set of almost-sure winning states. Consider the game shown in Fig [3] with actions {a, 6} for player 1 and 
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ae, be 




bd 



Figure 3: A Biichi game 



{c, d, e} for player 2 at sq- States si, S2 are absorbing, and from S3 the successor is sq deterministically. 
The Biichi objective is to visit {si, S3} infinitely often. The only almost-sure winning state is {si}. The 
state So is not almost-sure winning because at sq if player 1 plays b with positive probability the counter 
move is d, otherwise the counter move is c. Hence either S2 is reached with positive probability or sq is 
never left. Moreover, player 1 cannot limit-sure reach the state si from sq, as the move e ensures that si is 
never reached. Thus in this game the limit-sure reach to the almost-sure winning set is only state si. We 
now show that for all e, there is a memoryless strategy to ensure the Biichi objective with probability at 
least 1 — e from sq. At sq the memoryless strategy plays a with probability 1 — e and b with probability 
e. Fixing the strategy for player 1 we obtain an MDP for player 2, and in the MDP player 2 has an optimal 
pure memoryless strategy. If player 2 plays the pure memoryless strategy e, then S3 is visited infinitely often 
with probability 1; if player 2 plays the pure memoryless strategy c, then si is reached with probability 1; 
and if player 2 plays d, then si is reached with probability 1 — e. Thus for all e > 0, player 1 can win from 
So and S2 with probability at least 1 — e with a memoryless strategy. 

Limit-winning set for Biichi objectives. We first present the characterization of the set of limit-sure win- 
ning states for concurrent Biichi games from BdAHOOl for infinite-memory and infinite-precision strategies. 
The limit-sure winning set is characterized by the following formula 

i^Yo.f,Xo.[iB nPreiiYo)) U {^B nLpre,(Yo,Xo))] 

Our characterization of the limit-sure winning set for memoryless infinite-precision strategies would be 
obtained as follows: we will obtain sequence of chunk of states ^o ^ -'^1 ^ • • • ^ ^k such that from each 
Xi for all e > there is a memoryless strategy to ensure that OXi^i U {nOB n o{Xi \ Xi_i)) is satisfied 
with probability at least 1 — e. We consider the following /x-calculus formula: 

uYi.fiXi.uYo.fiXo.[{BnPrci{Yo)\SLpm,{YuXi))U{^BnAprc^{Yo,Xo)\SLpm^{Yi,Xi))] 

Let Y* be the fixpoint, and since it is a fixpoint we have 



Y* = imXi.uY^.^iXq. 



(SnPrei(yo)WLprei(y*,Xi))u 
(-5 n Aprei(yo, Xo)yLprei(y*, Xi)) 



Hence Y* is computed as least fixpoint as sequence of sets Xq C Xi 
Xj as 



C Xyfc, and Xj+i is obtained from 



i.yo.M^o.[(5nPrei(yo)yLprei(y*,X,))U(-SnAprei(yo,^o)yLprei(y*,Xi))] 

The Lprej(y*,Xj) is similar to limit-sure reachability to Xi, and once we rule out Lpre]^(y*,Xj), the 
formula simplifies to the almost-sure winning under memoryless strategies. In other words, from each Xj+i 
player 1 can ensure with a memoryless strategy that either (i) Xi is reached with limit probability 1 or 
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(ii) the game stays in Xi^i \ Xi and the Biichi objective is satisfied with probability 1. It follows that 
Y* C Limit i{IP , M, aOB). We will show that in the complement set there exists constant 77 > such 
that for all finite-memory infinite-precision strategies for player 1 there is a counter strategy to ensure the 
complementary objective with probability at least r/ > 0. 

The general principle. The general principle to obtain the /x-calculus formula for limit-sure winning 
for memoryless infinite-precision strategies is as follows: we consider the //-calculus formula for the 
almost-sure winning for uniform memoryless strategies, then add a vYn+ijjiXn+i quantifier and add the 
Lpre]^(y„+i, X„+i)|*J to every predecessor operator. Intuitively, when we replace Yn+i by the fixpoint Y*, 
then we obtain sequence Xi of chunks of states for the least fixpoint computation of Xn+i, such that from 
Xj_|_i either Xi is reached with limit probability 1 (by the Lpre]^(y*, X„_|_i) operator), or the game stays in 
Xj+i \ Xi and then the parity objective is satisfied with probability 1 by a memoryless strategy. Formally, 
we will show Lemma [T3l and we first present a technical lemma required for the correctness proof. 

Lemma 12 (Basic Lpre principle). Let X C Y C Z C S and such that all s G Y \ X we have s G 
Lprei{Z,X). For all prefix-independent events ^ C n{Z\ Y), the following assertion holds: 

Assume that for allrj > there exists a memoryless strategy vr^ € II J^ such that for all tt2 G 112 
and for all z ^ Z \Y we have 

Vxl^'^^iA U oy) > 1 - r/, (le., lim Vrf'^'^iA U O^) = 1). 

Then, for all s G Y for all e > there exists a memoryless strategy vrf G Hf^ such that for all 
7r2 G 112 we have 

Prli'^'Mu OX) > 1 - e, (i.e., l[mPrf''''\AU OX) = 1). 

Proof. The situation is depicted in Figure |4](a). Since for all s G y \ X we have s G Lpre^(Z, X), given 
e > 0, player 1 can play the distribution S,g^-[^[e]{Z, X) to ensure that the probability of going to -iZ is at 
most e times the probability of going to X. Fix a counter strategy 7r2 for player 2. Let 7 and 7' denote the 
probability of going to X and -iZ, respectively. Then 7' < e • 7. Observe that 7 > e\ where / = IP^I. Let 
a denote the probability of the event A. We first present an informal argument and then present rigorous 
calculations. Since ^ C ^ u O-'^, the worst-case analysis for the result correspond to the case when a = 0, 
and the simplified situation is shown as Fig|4l(b). Once we let rj ^ 0, then we only have an edge from Z\Y 
to y and the situation is shown in Fig|4l(c). If q is the probability to reach X, then the probability to reach 
->Z is q- e and we have q + qe = 1, i.e., q = j^, and given e' > we can chose e to ensure that q > 1 — e'. 
We now present detailed calculations. Given e' > we construct a strategy vrf as follows: let e = 
^,-^_ A and r] = e'+^ > 0; and fix the strategy vr^ for states in Z \ y and the distribution ^g'j^^^[e](Z, X) at 

s. Observe that by choice we have r? < 7 • e. Let q = Pr^ ^ ''"^ {A U OX). Then we have g > 7 + /? • (a + 
{1 — 7] — a) ■ q); since the set Z \ y is reached with probability at most /? and then again Y is reached with 
probability at least I — r] — a and event A happens with probability at least a. Hence we have 

q > J + (3 ■ {a + {1 - r] - a) ■ q) > J + (3 ■ [a ■ q + (1 - 1] - a) ■ q) = J + 13 ■ {1 - rj) ■ q; 
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Figure 4: Basic Lpre principle; in the figures /3=1 — 7 — 7-6 



the first inequality follows as g < 1. Thus we have 



q > 7 + (l -7-7-e) • (1 -7?) -g; 

^ 7 

7 + 7-e + r/ — ry-7 — r/-7-e 

7 



> 



> 



7 + 7 • e + 77 

7 



7 + 7 • e + 7 •£ 



(since r/ < 7 • e) 



The desired result follows. 



Lemma 13 For a parity function p : S >—^ [1..2n] and T Q S, we have W C Limiti{IP, M,Parity(p) U 
OT), where W is defined as follows: 

uYn.liXn.yYn-l.fxXn-l. ■ ■ ■ vYi.^iXi.vYq.jiXq. 

T 

B2n n Prei {Yn-i) ISLpre^ (y„, X„) 

U 

B2n-i n APreOddi (0, Y^-i, Xn-i)\SLpre^ (y„, X„) 

U 
S2„_2 n APreSvewi (0, Yn-i, X„_i , y„_2) HL/^rei (y„, X„) 

u 

S2n-3 n APreOddiil, y„_i, X„_i, y„_2, X„_2) yL;7rei(y„, X„) 

u 

B2 HAPreEvemin - 2, y„_i, X„_i, . . . , Yi,Xi,Yo)\*}Lprei{Yn, X„) 

U 
5i n APreOddiin - 1, y„_i, X„_i, . . . , Fq, Xo)yLprei(y„, X„) 
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Proof. We first reformulate the algorithm for computing W in an equivalent form. 

fiXn-l'Yn-i.fiXn-l- ■ ■ ■ vYi.jiXi.vYq.^iXq. 

T 

B2n n Prei (y„_ 1 ) y Lprei {W,Xn) 

U 

B2n-i n APreOddi(0, y„_i, X„_i) yLprei(l^, X„) 

U 
B2n~2 n APreEvem (0, y„_i , X„_i , y„_2) y Lprei (1^, X„) 

u 

52„-3 n APreOddi(l, y„_i, X„_i, y„_2, ^n-2)y Lprei(H^, X„) 

u 

B2 n APreEveni(n - 2, y„_i, X„_i, . . . , yi, Xi, yo)yLprei(W^, X„) 

U 
5i n APreOddi(n - 1, y„_i,X„_i, . . . ,yo,Xo)HLprei(VF,X„) 

The reformulation is obtained as follows: since W is the fixpoint of Yn+i we replace Yn+i by VF everywhere 
in the ^u-calculus formula, and get rid of the outermost fixpoint. The above mu-calculus formula is a least 
fixpoint and thus computes W as an increasing sequence T = Tq C Ti C T2 C • • • C T^ = W of states, 
where m > 0. Let Li = Ti\Ti^i and the sequence is computed by computing Tj as follows, for < i < m: 



uYn^l.fiX, 



n-1- • • • 



iyYi.iJ.Xi.iyYo.fj,Xo. 



T 

52n nPrei(y„„i)yLprei(l^,T,_i) 

U 

B2n-i n APreOddi(0, y„_i, X„_i) ^ Lprei(H^, T^^i) 

U 
B2n-2 n APreEvem (0, Y^-i, X^-i, Yn-2) \S Lprci {W, T^.i) 

U 
B2n-3 n APreOddi(l, y„_i, X„_i, y„_2, X„_2) b)Lprei(H^, Ti_i) 

U 



B2 n APreEveni(n - 2, y„_i, X„_i, . . . , yi, Xi, yg) ^ Lprei(H^, Ti^i) 

U 
Bi n APreOddi(n - 1, y„„i, X„_i, . . . , yo, Xq) HLprei(l^, r,_i) 

The above formula is obtained by simply replacing the variable Xn by Tj_i. The proof that W C 
Ljm/?i(/P,M, Parity (p) U OT) is based on an induction on the sequence T = Tq C Ti C r2 C • • • C 
Tm = W. For I < i < m, let Vi = W \ Tm-i, so that Vi consists of the last block of states that has been 
added, V2 to the two last blocks, and so on until Vm = W. We prove by induction on i € {1, ... , m}, from 
i = 1 to i = m, that for all s ^ Vi, for all ?? > 0, there exists a memoryless strategy vr^ for player 1 such 
that for all 112 € 112 we have 

Pr"''"' {oTra-i U Parity(p)) > 1 - r/. 

Since the base case is a simplified version of the induction step, we focus on the latter. 
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For Vi \ Vi-i we analyze the predecessor operator that s ^ Vi\ V-i^i satisfies. The predecessor operators 
are essentially the predecessor operators of the almost-expression for case 1 modified by the addition of 
the operator Lpre]^(T^, Tm_j) |*J . Note that since we fix memory less strategies for player 1, the analysis 
of counter-strategies for player 2 can be restricted to pure memoryless (as we have player-2 MDP). We fix 
the memoryless strategy for player 1 according to the witness distribution of the predecessor operators, and 
consider a pure memoryless counter-strategy for player 2. Let Q be the set of states where player 2 plays 
such the Lpre^(l^, Tm-i) part of the predecessor operator gets satisfied. Once we rule out the possibility of 
LprC]^ {W, Tm~i), then the //-calculus expression simplifies to the almost-expression of case 2 with Q U T as 
the set of target, i.e., 

(ruQ) 

52„,nPrei(y„_i) 

u 

B2n-i n APreOddi(0, y„_i, X„_i) 

u 

B2n-2 n APreEveni(0, y„_i, X„_i, y„_2) 

u 

S2„_3 n APreOddi(l, y„_i, X„_i, y„_2, ^n-2) 

u 



vYn-i-iiXn-i- ■ ■ ■ uYi.flXi.uYo.flXo. 



B2 n APreEvem (n - 2, y„_i , Xn-i, ■ ■ ■ ,Yi,Xi,Yq) 

u 

Bi n APreOddi(n - l,y„_i,X„_i, . . . ,yo,Xo) 

This ensures that if we rule out Lpre]^(VF, Tm-i) from the predecessor operators and treat the set Q as 
target, then by correctness of the almost-expression for case 2 we have that the Parity (p) U 0(Q U T) is 
satisfied with probability 1. By applying the Basic Lpre Principle (Lemma \Y2\ with Z = W, X = Tm-i, 
A = Parity (p) and y = X U Q, we obtain that for all r/ > player 1 can ensure with a memoryless 
sti^ategy that Parity (p) U OTm-j is satisfied with probability at least I — rj. This completes the inductive 
proof. With i = m-we obtain that for all rj > 0, there exists a memoryless strategy vr^ such that for all states 

s e Vm = W and for all 7r2 we have Fr'^^''"^{OTo U Parity (p)) > 1 - rj. Since Tq = T, the desired result 
follows. I 

We now define the dual predecessor operators (the duality will be shown in LemmafTSl). We will first use 
the dual operators to characterize the complement of the set of hmit-sure winning states for finite-memory 
infinite-precision strategies. We now introduce two fractional predecessor operators as follows: 

FrPreOdd2(i, Yn,Xn, • • • , Yn-i,Xn-i) 

= Fpre2(X„,y„)yApre2(X„,y„-i)y • • • yApre2(X„_i+i,y,,_i)yPre2(X„_j) 

FrPreEven2(i, y„, X„, • • • , Yn-i, Xn-i,Yn^i^i) 

= Fpre2 (X„ , y„ ) l*J Apre2 (X„ , y„_ 1 ) 

[*]••• [*JApre2(X„_i+i,y„_j)yApre2(X„_j,y„_i_i) 

The fractional operators are same as the PosPreOdd and PosPreEven operators, the difference is the 
Pospre2(y„) is replaced by Fpre2(X„, y„). 
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Remark 2 Observe that if we rule out the predicate Fpre2{Xn,Yn) the predecessor operator 
FrPreOdd2{i, Yn, X„, Yn, ■ ■ ■ , Yn-i, Xn-i) (resp. FrPreEven2{i, Yn, X„, y„„i, . . . , y„_i, X„_j, y„_i_i)j, 
then we obtain the simpler predecessor operator APreEven2{i,Xn,Yn~i, ■ ■ ■ ,Yn^i,Xn-i) (resp. 
APreOdd2{i, X„, y„_i, . . . , y„_i, X„_i, Yn-i-i)). 

The formal expanded definitions of the above operators are as follows: 

APreOddi(j,y„,X„, . . . , y„__i,X„_j)yLprei(y„+i,X„+i) = 

(P^'«^(X„+i)>a.p|^'«^(-y„+i)) 

V 

(p|^'«2(x„)>0AP|i'«^(y„) = i) 

V 

(p^'«^(x„_i) > AP|^'«^(y„_i) = 1) 

V 



sG5|Va>0.3eiGxf-Ve2Gx!. 



3?i,e 



V 



pi^'^^(x„_,) > A Pi^'^^(y„-.) = 1 



?i,6 



APreEveni(i, y„, X„, . . . , y„„i, X„_.j, y„_j_i) ^ Lprei(y„+i, X„+i) = 

(p^'«^(x„+i)>«.p|^'«^(-y„+i)) 

V 

(p^'«^(x„)>OAP|^'«^(y„) = i) 

V 

(p^'«^(x„_i) > AP|^'«^(y„_i) = 1) 

V 
V 

(P|^'«^(X„„,) > A Pl"^'{Yn^^) = 1) 

V 

(p|^'«^(y„_,_i) = i) 



sG5|Va>0.3eiGx?-Ve2Gxi- 
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s G 5 I 3/3 > O.VCi G xf -36 G xl 



The formal expanded definitions of tlie above operators are as follows: 
FrPreOdd2(i, y„, X„, . . . , Yn-i, X^-i) = 

V 

(Pt'^^Yn-i) > A Pl"^'{Xn) = 1) 

V 

(p|^'«^(y„_2) > A p|^'«^(x„_i) = 1) 

V 

V 

(p|i'«^(y„_0 > A p^'«^(x„_,+i) = 1) 

V 

FrPreEven2(i, Yn, X„, . . . , y„_j, X„_i, Yn-i-i) = 

{Pt'^'{Yn)>(3-Pt^^'{^Xn)) 

V 

(p|^'«^(y„_i) > A pt'^'iXn) = 1) 

V 

{Pt'^^Yn-2) > A P|^'«^(X„_i) = 1) 

V 

V 

(p|i'«^(y„_i_i) > A p|^'«^(-x„_i) = 1) 

We now show the dual of Lemma [T3l 
Lemma 14 For a parity function p : S >-^ [1..2n] we have Z C ^Limiti{IP , FM , Parity (p)), where Z is 



sGS|3/3>0.V6Gxf.3e2Gxi- 
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defined as follows: 



^Yn.vXn.flYn-l.vXn-l- ■ ■ ■ IiYimXi.^Yq.vXq. 

B2n n FrPreEven2{0, Yn,Xn, Yn-i 

U 

B2n-i n FrPreOdd2{l, y„, X„, y„_i, X„_i) 

u 

B2n-2 n FrPreEven2{l, Yn, X„, y„_i, X„_i, y„_2) 

U 
B2n-3 n FrPreOdd2{2, y„, X„, y„_i, X„_i, y„_2, ^n-2) 

u 

-B2n-4 n FrPreEven2{2, Yn,Xn, y„_i, X„_i, K„_2, ^n-2, ^n-s) 
S3 n FrPreOdd2{n - 1, y„, X„, y„_i, X„_i, . . . , Fi, Xi) 

u 

B2 n FrPreEven2{n - 1, y„, X„, y„_i, X„„i, . . . , Yi, Xi, Yq) 

U 
Bi n FrPreOdd2{n, Y^, X„, y„_i, X„_i, . . . , Yi, Xi, Yq, ^0) 

Proof. For k > 0, let Z^ be the set of states of level k in the above /x-calculus expression. We will 
show that in Zk, there exists constant Pk > 0, such that for every finite-memory strategy for player 1, 
player 2 can ensure that either Z^^i is reached with probability at least /3fc or else coParity(p) is satisfied 
with probability 1 by staying in {Zk \ Zk~i)- Since Zq = 0, it would follow by induction that Zj. n 
Limit i{IP, FM , Parity (p)) = and the desired result will follow. 

We obtain Z^ from Zk-i by adding a set of states satisfying the following condition: 

B2n n FrPreEven2(0, Zk-i,Xn, l"„-i 

U 

B2n-i n FrPreOdd2(l, Zfc„i, X„, y„_i, X„_i) 

u 

B2n-2 n FrPreEven2(l, Zk-i,Xn, y„_i, X„_i, y„_2) 

u 

B2n-3 n FrPreOdd2(2, Zfc_i, X„, y„_i, X„_i, y„_2, Xn-2) 

u 

B2n-i n FrPreEven2(2, Z^^i, X„, y„_i, X„_2, yn-2, ^n-2, ^n-3) 

S3 n FrPreOdd2(n - 1, Zfc_i, X„, K„_i, X„_i, . . . , Yi, Xi) 

U 
S2 n FrPreEven2(n - 1, Zfc_i, X„, y„_i, X„_i, . . . , Fi, Xi, Yb) 

U 
Bi n FrPreOdd2(n, Zfc„i, X„, y„_i, X„_i, . . . , Fi, Xi, Fq, ^0) 



i/X„./iy„_i.i/X„_i. • • • jiYi.uXi.iiYQ.vXQ. 



The formula is obtained by removing the outer ^ operator, and replacing Yn+i by Zk-i (i.e., we iteratively 
obtain the outer fixpoint of Yn+i). If the probability of reaching to Zj^^i is not positive, then the following 
conditions hold: 
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• If the probability to reach Z^-i is not positive, then the predicate Fpre2(X„, Zk-i) vanishes from the 
predecessor operator FrPreOdd2(i, Zfc_i, X„, y„_i, . . . , Yn-i, Xn-i), and thus the operator simpli- 



fies to the simpler predecessor operator APreEven2(i, X„, y„_i, , 



; -^ n— i; -^n—i) 



• If the probability to reach Z^^i is not positive, then the predicate Fpre2(X„, Z^-i) vanishes from the 
predecessor operator FrPreEven2(i, Zk-i,Xn,Yn-i, . . . , Yn-i, Xn-i,Yn-i-i), and thus the operator 
simplifies to the simpler predecessor operator APreOdd2(i, Xn,Yn-i, ■ ■ ■ , Yn-i, Xn-i,Yn-i-i). 

Hence either the probability to reach Z^^i is positive, and if the probability to reach Z^-i is not positive, 
then the above /x-calculus expression simplifies to 

B2n n APreOdd2(0, X„, y„_i) 

u 

B2n-i n APreEven2(l, X„, y„_i, X„_i] 

U 

B2n-2 n APreOdd2(l, x„, y„_i, x„_i, y„_2) 

Z* = vXn-lJym-lvXm-l ■ ■ ■ IjYl .V Xi . ^iYq . 

Bs n APreEven2(n - 2, X„, . . . , Yi,Xi] 

u 

^2 n APreOdd2(n - 1,X„, . . .,Yi,Xi,Yo) 

U 

Bi n APreEven2(n - 1, X„, . . . , Yi,Xi,Yo, Xq) 

We now consider the parity function p — 1 : S i-^ [0..2n — 1], and observe that the above formula is same as 
the dual almost-expression for case 1. By correctness of the dual almost-expression we we have Z* C {s € 
5 I Vtti G U^3tt2 G n2. PrJi'''2(^coParity(p)) = 1} (since Parity(p + 1) = coParity(p)). It follows that if 
probability to reach Zf^_i is not positive, then against every memoryless strategy for player 1, player 2 can 
fix a pure memoryless strategy to ensure that player 2 wins with probability 1 . In other words, against every 
distribution of player 1, there is a counter-distribution for player 2 (to satisfy the respective APreEven2 and 
APreOdd2 operators) to ensure to win with probability 1 . It follows that for every memoryless strategy for 
player 1, player 2 has a pure memoryless strategy to ensure that for every closed recurrent C C Z* we 
have min(p(C)) is odd. It follows that for any finite-memory strategy for player 1 with Ai, player 2 has a 
finite-memory strategy to ensure that for every closed recurrent set C x M' C Z* xA4, the closed recurrent 
set C is a union of closed recurrent sets C of Z*, and hence min(p(C")) is odd (also see Example[3]as an 
illustration). It follows that against all finite-memory strategies, player 2 can ensure if the game stays in Z*, 
then coParity(p) is satisfied with probability 1. The Fpre2 operator ensures that if Z* is left and Zk-i is 
reached, then the probability to reach Z^-i is at least a positive fraction (3^ of the probability to leave Zk- 
In all cases it follows that Z^ C {s G 5 | 3/3^ > O.Vvri G nf*^.37r2 G n2.Pr^i'''2(coParity(p) U OZk-i) > 
/3fc}. Thus the desired result follows. I 

Lemma 15 (Duality of limit predecessor operators). The following assertions hold. 

1. Given X„+i C X„ C Xn-i C • • • C X„_j C y„_j C y„_j+i C • • • C y„ C Yn+i, we have 

FrPreOdd2 {i + 1, -^Yn+i,^Xn+i,-Yn, ^Xn, ■ ■ ■ , -^Yn-i, ^Xn-i) 

= ^{APreOddi{i, Yn,Xn, ..., Yn-i, Xn-i)\S^Pf'^l0^n+l, Xn+i)). 
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2. Given Xn+i C X„ C Xn-i Q ■■■ Q Xn-i C Yn-i-i C K„_j C Yn-i+i ^ • • • C y„ C Yn+i and 
s € S, we have 

FrPreEven2 {i + 1, ^y„+i, ^X„+i, ^y„, ^X„, . . . , 
= -. {APreEveni (i , y^ , X^ , . . . , Yn-i , X„. 

Proof. We present the proof for part 1, and the proof for second part is analogous. To present the proof of 
the part 1, we present the proof for the case when n = 1 and i = 1. This proof already has all the ingredients 
of the general proof, and the generalization is straightforward as in Lemma [TT] 

Claim. We show that for Xi (1 Xq <^ Yq (Z Yi we have 

Fpre2(-Xi,-yi) t*J Apre2(-Xi,-yo) W Pre2(-Xo) = -(Lprei(yi,Xi) [*J Aprei(yo,Xo)). We 
start with a few notations. Let St C r2(s) and Wk C r2(s) be set of strongly and weakly covered actions 
for player 2. Given St C Wk C r2(s), we say that a set [/ C ri(s) satisfy consistency condition if 

yb £ St. Dest{s,U,b)n Xi /0 

V6 G Wk. {Dest{s, U, 6) n Xi y^ 0) V {Dest{s, U, b)CYoA Dest{s, U, b) n Xq ^ 0) 

A triple ([/, St, Wk) is consistent if U satisfies the consistency condition. We define a function / that takes 
as argument a triple ([/, St,Wk) that is consistent, and returns three sets /([/, St,Wk) = ([/', St', Wk') 
satisfying the following conditions: 

(1) Dest{s,U',T2is)\y\/k) CYi- 

(2) St' = {6 G r2(s) I Dest{s, U' , b) D Xi ^ 0} 

(3) Wk' = {6 € r2(s) I {Dest{s, U', 6) n Xi / 0) V {Dest{s, U', b)CYoA Dest{s, U', 6) n Xq / 0)} 

We require that ([/, St, Wk) C ([/', St', Wk') and also require / to return a larger set than the input argu- 
ments, if possible. We now consider a sequence of actions sets until a fixpoint is reached: St_i = Wk_i = 
U-i = and for i > we have (C/j,Sti, Wkj) = /(C/j_i, Stj_i, Wkj_i). Let ([/*, St*, Wk*) be the set 
fixpoints (that is / cannot return any larger set). Observe that every time / is invoked it is ensured that the 
argument form a consistent triple. Observe that we have St.; C Wkj and hence St* C Wk*. We now show 
the following two claims. 

1. We first show that if Wk* = r2(s), then s e Lprei(yi, Xi)|*jAprei(yo, Xq). We first define the rank 
of actions: for an action a £ U^: the rank £{a) of the action is min, a G Ui. For an action b G r2(s), 
if 6 G St*, then the strong rank £s{b) is defined as miiij b G St^; and for an action b G Wk*, the 
weak rank £w{b) is defined as mirij b G Wkj. For e > 0, consider a distribution that plays actions in 
Ui with probability proportional to e*. Consider an action b for player 2. We consider the following 
cases: (a) If 6 G St*, then let j = is{b)- Then for all actions a G Uj we have Dest{s, a, b) C Yi 
and for some action a G Uj we have Dest{s, a, b) H Xi ^ 0, in other words, the probability to leave 
Yi is at most proportional to e^^^ and the probability to goto Xi is at least proportional to e^, and 
the ratio is e. Since e > is arbitrary, the Lpre]^(yi,Xi) part can be ensured, (b) If b ^ St*, then 
let j = £w{b)- Then for all a £ U^ we have Dest{s, a, b) C Yq and there exists a £ U^ such that 
Dest{s, a, b) n Xq / 0. It follows that in first case the condition for Lpre^ {Yi , Xi ) is satisfied, and in 
the second case the condition for Apre]^(yo, Xq) is satisfied. The desired result follows. 

2. We now show that r2(s) \ Wk* 7^ 0, then s G Fpre2(^Xi, ^yi) i*J Apre2(^Xi, ^yo) y Pre2(^Xo). 
Let U = Ti{s) \ [/*, and let Bk = T2{s) \ Wk* and Bs = T2{s) \ St*. We first present the required 
properties about the actions that follows from the fixpoint characterization. 
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(a) Property 1. For all b G Bk, for all a G f7* we have 

Dest{s, a, b) C ^Xi A {Dest{s, a, b) C -^Xq V Dest{s, a, b) D -iYq 7^ 0). 

Otherwise the action b would have been included in Wk* and Wk* could be enlarged. 

(b) Property 2. For all b £ Bs and for all a G C/* we have Dest{s, a, b) C -1X1. Otherwise b would 
have been included in St* and St* could be enlarged. 

(c) Property 3. For all a £ U, either 

i. Dest{s, a, Bk) n -Yi / 0; or 
ii. for all b G Bg, Dest{s, a, b) C -1X1 and for all b G B^, 

Dest{s, a, b) C -nXi A {Dest{s, a, b) C -nXo V Dest{s, a, b) D -^Yq / 0) 

The property is proved as follows: if Dest{s,a,Bk) C Y^ and for some 6 G i?s we have 
Dest{s,a,b) fi Xi / 0, then a can be included in [/* and b can be included in St*; if 
Dest{s, a, BjS) C Yi and for some b £ B^^Ne. have 

{Dest{s, a, 6) n Xi / 0) V {Dest{s, a, 6) n Xq 7^ A L'esi(s, a, 6) C Yq) 

then a can be included in U^, and b can be included in Wk*. This would contradict that 
([/*, St*, Wk*) is a fixpoint. 

Let ^1 be a distribution for player 1. Let Z = Supp(^i). We consider the following cases to establish 
the result. 

(a) We first consider the case when Z C U^. We consider the counter distribution ^2 that plays all 
actions in Bk uniformly. Then by property 1 we have (i) Dest{s, ^1, ^2) ^ "'-'^i; and (ii) for all 
a G -Z' we have Dest{s, a, ^2) ^ ^Xq or Dest{s, a, ^2) H -iYq 7^ 0- If for all a £ Z we have 
Dest{s,a,^2) ^ ~^Xq, then Dest{s, ^1,^2) C -iXq and Pre2(-'Xo) is satisfied. Otherwise we 
have Z?est(s,^i,^2) ^ ^Xi and Dest{s, ^1,^2) H -iYq 7^ 0» i-c, Apre2(-'Xi, -^Yq) is satisfied. 

(b) We now consider the case when Z n C/ / 0. Let Uq = C/*, and we will iteratively compute 
sets Uq <Z Ui <Z Z such that (i) Dest{s,Ui,Bs) C -1X1 and (ii) for all a £ Ui we have 
Dest{s, a,Bk) C -iXq or Dest{s, a,Bk) C -ilg (unless we have already witnessed that player 2 
can satisfy the predecessor operator). In base case the result holds by property 2. The argument 
of an iteration is as follows, and we use Ui = Z \Ui. Among the actions of Z n Ui, let a* be 
the action played with maximum probability. We have the following two cases. 

i. If there exists b £ Bg such that Dest{s, a*, b) n -^Yl / 0, consider the counter action b. 
Since b £ Bg, by hypothesis we have Dest{s, Ui, b) C -1X1. Hence the probability to go 
out of -1X1 is at most the total probability of the actions in Z nUi and for the maximum 
probabihty action a* £ Z nUi the set -lYi is reached. Let r/ > be the minimum positive 
transition probability, then fraction of probability to go to -lYi as compared to go out of 
-1X1 is at least f3 = rj ■ ip \s. > 0. Thus Fpre2(-'-^i, -lyi) can be ensured by playing b. 

ii. Otherwise, by property 3, (i) either Dest{s, a*, Bj.) n -lYi 7^ 0, or (ii) for all b £ Bg we 
have Dest{s, a^:,b) C -1X1 and for all b £ Bk 

Dest{s, a*, b) C -^Xi A {Dest{s, a* ,b) C ^Xq V Dest{s, a*,b)n -^Yq / 0) 
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If Dest{s,a*,Bk) n -^Yi ^ 0, then chose the action b e Bk such that Dest{s,a*,b) D 
-ill 7^ 0- Since h ^ Bk Q Bg, and by hypothesis Dest{s,Ui,Bs) C ^Xi, we have 
Dest{s, Ui,b) C -iXi- Thus we have a witness action b exactly as in the previous case, 
and like the proof above Fpre2(-'Xi, -lyi) can be ensured. If Dest{s,a*,Bk) C Yi, 
then we claim that Dest{s,a*, Bg) C -iXi. The proof of the claim is as follows: if 
Dest{s,a*,Bk) C Yi and Dest{s,a*,Bs) n Xi / 0, then chose the action b* from Bg 
such that Dest{s, a*,b*) n Xi / 0, and then we can include a* to U^: and b* to St* (contra- 
dicting that they are the fixpoints). It follows that we can include a* G f/j+i and continue. 

Hence we have either already proved that player 2 can ensure the predecessor operator or Ui = Z 
in the end. If Ui is Z in the end, then Z satisfies the property used in the previous cases of [/* 
(the proof of part a), and then as in the previous proof (of part a), the uniform distribution over 
Bk is a witness that player 2 can ensure Pre2(Xo) |*J Apre2(-'Xi, -'Yq). 

General case. The proof for the general case is a tedious extension of the result presented for n = 1 and 
i = 1. We present the details for the sake of completeness. We show that for Xn+i C Xn ^ Xn-i ^ • • • C 
Xn-i ^ Yn-i C Yn-i+1 ^ • • • C y„ C Yn+i, wc havc 

FrPreOdd2 {i + 1, -^Y^+i, ^^n+i, -^Yn, ^X„, . . . , -^Y^-i, ^X^-i) 

= ^ (APreOddi (i , y„ , X„ , . . . , Y^-i , Xn~i ) \*j Lpre^ (y„+i , X„+i ) ) . 

We use notations similar to the special case. Let St C T2{s) and Wk C T2{s) be set of strongly and weakly 
covered actions for player 2. Given St C Wk C r2(s), we say that a set [/ C ri(s) satisfy consistency 
condition if 

V6 G St. Dest{s, U, b) n X^+i + 

V6 G Wk. {Dest{s, U, b) n X^+i / 0) V 30 < j < i.{Dest{s, U, b) C Y^^j A Dest{s, U, b) n X^-j / 0) 

A triple {U, St, Wk) is consistent if U satisfies the consistency condition. We define a function / that takes 
as argument a triple (f^, St, Wk) that is consistent, and returns three sets /([/, St,Wk) = ([/', St', Wk') 
satisfying the following conditions: 

(1) Dest{s,U',r2{s)\\Nk) CYn+i; 

(2) St' = {b£ T2{s) I Dest{s, U\ b) n X-^+i + 0} 

(3) Wk' = {6 G r2(s) I (pesi{s, [/', b) n X„+i / 0)V 

30 < i < i.{Dest{s, U' , b) C Yn-j A Dest{s, U' , b) n Xn-j / 0)} 

We require that ([/, St, Wk) C ([/', St', Wk') and also require / to return a larger set than the input argu- 
ments, if possible. We now consider a sequence of actions sets until a fixpoint is reached: St_i = Wk_i = 
[7-1 = and for i > we have (C/i,Stj, Wkj) = /(C7j_i, Sti_i, Wkj_i). Let ([/*, St*, Wk*) be the set 
fixpoints (that is / cannot return any larger set). Observe that every time / is invoked it is ensured that the 
argument form a consistent triple. Observe that we have Stj C Wkj and hence St* C Wk*. We now show 
the following two claims. 

1. We first show that if Wk* = r2(s), then s G Lprei(y„+i, X„+i)yAPreOddi(i, !"„, X„, . . . , Yn-i, Xn- 
We first define the rank of actions: for an action a £ U^: the rank i{a) of the action is miiij a G Ui. 
For an action 6 G r2(s), if fo G St*, then the strong rank £s{b) is defined as miiij 6 G Stj; and for an 
action b G Wk*, the weak rank £w{b) is defined as min.j b G Wkj. For e > 0, consider a distribution 
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that plays actions in Ui with probabiUty proportional to e*. Consider an action b for player 2. We 
consider the following cases: (a) If 6 G St*, then let j = is{b). Then for all actions a G Uj we have 
Dest{s, a, b) C y„+i and for some action a € Uj we have Dest{s, a, b) n X„+i / 0, in other words, 
the probability to leave Yn+i is at most proportional to e^+^ and the probability to goto Xn+i is at 
least proportional to e^ , and the ratio is e. Since e > is arbitrary, the Lpre^(y„+i, X^+i) part can 
be ensured, (b) If 6 St*, then let j = iw{b). Then for all a G U^ there exists < j < i such 
that we have Dest{s, a, b) C Yn-j and there exists a £ U^: such that Dest{s, a, b) n Xn-j / 0. It 
follows that in first case the condition for Lpre]^(l^j+i, X„+i) is satisfied, and in the second case the 
condition for APreOddi(i, Yn,Xn, ■ ■ ■ , Yn~i, Xn~i) is satisfied. The desired result follows. 

2. We now show that T2{s) \ Wk* / 0, then 

s G FrPreOdd2(z + 1, ^y„+i, ^X„+i, ^y„, ^X„, . . . , ^y„_i, ^X„__j). 

Let U = Ti{s) \ [/*, and let Bk = T2{s) \ Wk* and Bs = T2{s) \ St*. We first present the required 
properties about the actions that follows from the fixpoint characterization. 

(a) Property 1. For all b £ Bk, for all a £ U^ v/e have 

Dest{s, a, b) C ^X„+i A 30 < j < i.{Dest{s, a, b) C -nXn-j V Dest{s, a, b) D ^y„-j / 0). 

Otherwise the action b would have been included in Wk* and Wk* could be enlarged. 

(b) Property 2. For all b £ Bs and for all a G C/* we have Dest{s, a, b) C -iX„+i. Otherwise b 
would have been included in St* and St* could be enlarged. 

(c) Property 3. For all a £ U, either 

i. Dest{s, a, Bk) n -^Yn-\-i / 0; or 
ii. for all b £ Bs, Dest{s, a, b) C -iXn+i and for all b £ Bk, 

Dest{s,a,b) C ^X„+iA30 <j< i.{Dest{s,a,b) C -nXn^jyDest{s,a,b)n^Yn-j / 0) 

The property is proved as follows: if Dest{s,a, Bk) C y„_|_i and for some b £ Bg we have 
Dest{s,a,b) H Xn+i 7^ 0, then a can be included in L^* and b can be included in St*; if 
Dest{s, a,Bk) C y„+i and for some b £ Bkwe. have 

{Dest{s,a,b)nXn+i / 0) V 30 < j < i.{Dest{s,a,b) n X^^j ^ ij) A Dest{s,a,b) C Y^^j) 

then a can be included in U^: and b can be included in Wk*. This would contradict that 
([/*, St*, Wk*) is a fixpoint. 

Let ^1 be a distribution for player 1. Let Z = Supp(^i). We consider the following cases to establish 
the result. 

(a) We first consider the case when Z C [/*. We consider the counter distribution ^2 that plays all 
actions in Bk uniformly. Then by property 1 we have (i) Dest{s, ^1, ^2) ^ ~'Xn+i', and (ii) for 
all a G Z there exists j < i such that Dest{s, a, ^2) Q ~^Xn-j or Dest{s, a, ^2) H -^Yn-j / 0. If 
for all a G Z wehave l?esi(s,a, ^2) ^ ^Xn^i,th&nDest{s,^i,^2) ^ ~'-'^n-i andPre2(-iX„_j) 
is satisfied. Otherwise, there must exists j < i such that Dest{s, ^1,^2) ^ ^Xn+i~j and 
Dest{s, Ci, 6) n -^Yn-j / 0, i.e., APreOdd2(J, -^Xn+i, -^Yn ..., -.X„_i+i, -^Yn^i) is satisfied. 
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(b) We now consider the case when Z n C/ 7^ 0. Let Uq = U^, and we will iteratively compute 
sets Uq '^ Ue '^ Z such that (i) Dest{s, Ue, Bg) Q -iX„+i and (ii) for all a € Ui there exists 
j < i such that Dest{s, a, Bk) ^ -iX„_j or Dest{s, a, B^) ^ ~'Yn-j (unless we have already 
witnessed that player 2 can satisfy the predecessor operator). In base case the result holds by 
property 2. The argument of an iteration is as follows, and we use U^ = Z \ Uc. Among the 
actions of Z n U£, let a* be the action played with maximum probability. We have the following 
two cases. 

i. If there exists b ^ Bg such that Dest{s, o*, 6) fl -■l^n+i 7^ 0, consider the counter action b. 
Since b G Bg, by hypothesis we have Dest{s, Ug, b) C -^Xn+i. Hence the probability to go 
out of -^Xn+i is at most the total probability of the actions in Z nU£ and for the maximum 
probability action a* € Z n Ue the set -'Yn+i is reached. Let 77 > be the minimum 
positive transition probability, then fraction of probability to go to -'Yn-^-l as compared to 
go out of -^Xn+i is at least j3 = rj- .p \.^ > 0. Thus Fpre2(-'A^n+i, ~^Yn+i) can be ensured 
by playing b. 

ii. Otherwise, by property 3, (i) either Dest{s, a*, B^) n -■yn+i 7^ 0» or (ii) for all 6 G 5^ we 
have Dest{s, a*, b) C -iX„_|_i and for all b ^ B^ 

Dest{s,a*,b) C ^X„+iA30 < j < i.{Dest{s,a* ,b) C ^Xn-jyDest{s,a*,b)n^Yn-j ^ 

If Dest{s, a*,Bk) fl -lYn+i / 0, then chose the action b € B^ such that Dest{s, a*,b) n 
-iy„+i j^ 0. Since b G B^ CI Bg, and by hypothesis Dest{s,Ui,Bg) C -1X1, we have 
Dest{s,Ue,b) C -iXn+i- Thus we have a witness action 6 exactly as in the previous 
case, and like the proof above Fpre2{~'^n+i, ~'Yn+i) can be ensured. If Dest{s, a*, Bj^) C 
y„+i, then we claim that Dest{s, a*,Bg) C -iX„+i. The proof of the claim is as follows: 
if Dest{s, a* ,Bj^) C y„+i and Dest{s, a*, Bg) n X„+i / 0, then chose the action b* from 
Bg such that Dest{s, a*,b*) H Xn+i 7^ 0, and then we can include a* to [/=„ and 6* to St* 
(contradicting that they are the fixpoints). It follows that we can include a* € C/^+i and 
continue. 

Hence we have either already proved that player 2 can ensure the predecessor opera- 
tor or Ui = Z in the end. If Ui is Z in the end, then Z satisfies the property 
used in the previous cases of f7* (the proof of part a), and then as in the previous 
proof (of part a), the uniform distribution over Bk is a witness that player 2 can ensure 

Pre2(^X„_i)yAPreOdd2(i, ^X„+i, ^y„ . . . , -^Xn-i+i, ^y„-i)- 

The desired result follows. I 

Characterization o( Limiti{IP , M, $) set. From Lemma[T3l Lemma[T4l and the duality of predecessor op- 
erators (Lemma [T5]) we obtain the following result characterizing the limit-sure winning set for memoryless 
infinite-precision strategies for parity objectives. 

Theorem 4 For all concurrent game structures Q over state space S,for all parity objectives $ = Parity{p) 
for player 1, withp : S >-^ [1..2n], the following assertions hold. 

1. We have Limiti{IP, M, ^) = Limiti{IP, FM , ^), and Limit i {IP , FM , <l>) = W, where W is defined 
as the ^-calculus formula in Fig^ and Bi = p"^ {i) is the set of states with priority i, for i € [1..2n]. 
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uYn.flXnMYn-l.fJ.Xn~l. ■ ■ ■ vYi.fiXi.vYQ.flXQ. 

S2„ nPrei(y„_i)yLprei(y„,X„) 

u 

B2n-i n APreOddi(0, y„_i, X„_i)yLprei(y„, X„) 

u 

B2n-2 n APreEveni(0, y„_i, X„_i, y„_2)yLprei(y„, X„) 

u 

52n-3 n APreOddi(l, y„_i, X„_i, y„_2, X„_2)yLprei(y„, Xn) 

u 

B2 n APreEveni(n - 2, Y^-i^X^-i, ..., Yi,Xi,Yo)\SLpK^{Yn,X„ 

U 
Bi n APreOddi(n - 1, y„_i, X„_i, . . . , yo, Xo)yLprei(y„, X„) 



Figure 5: ^u-calculus formula for limit 

2. r/je set Limiti{IP, FM, $) can be computed symbolically using the fj,-calculus expression ofFig\5\in 

3. For s (^ S whether s E Limiti{IP, FM , ^) can be decided in NP (1 coNP. 

The NP n coNP bound follows directly from the ^-calculus expressions: the players can guess the 
ranking function of the /x-calculus formula and for each state the players guess the sequence of {Ai, St,, Wk,) 
to witness that the predecessor operators are satisfied. The witnesses are polynomial and can be verified in 
polynomial time. 

Independence from precise probabilities. Observe that the computation of all the predecessor operators 
only depends on the supports of the transition function, and does not depend on the precise transition proba- 
bilities. Hence the computation of the almost-sure and limit-sure winning sets is independent of the precise 
transition probabilities, and depends only on the supports. We formalize this in the following result. 

Theorem 5 Let Qi = {S,A, Fi, r2, 5i) and Q2 = {S,A, Fi, F2, 62) be two concurrent game structures that 
are equivalent, i.e., Qi = Q2. Then for all parity objectives ^, for all Ci € {P,U,FP,IP} and C2 G 

{M, FM, IM} we have (a) Almost^^{C 1,62, $) = Almost^%Ci,C2, $); and (b) Limitf^{Ci,C2, $) = 
Limitf^{Ci,C2,^). 

All cases of the above theorem, other than when Ci = IP and C2 = IM follows from our results, and 
the result for Ci = IP and C2 = IM follows from the results of lldAHOOL 

5 Conclusion 

In this work we studied the bounded rationality problem for qualitative analysis in concurrent parity games, 
and presented a precise characterization. The theory of bounded rationality for quantitative analysis is future 
work, and we beheve the results of this paper will be helpful in developing the theory. 
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